Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.628107464s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:57:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.628286208s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.638365489s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:56:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.639681308s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.810800377s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:55:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.810855247s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.640447069s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:55:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.64047765s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.75788876s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:54:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.757916947s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.632646391s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:53:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.632670963s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.64293677s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:52:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.642971819s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.81276647s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:52:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.812796143s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.311813533s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:51:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.311846147s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.912466528s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:51:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.912496413s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.388860979s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:51:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.388957075s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.808522512s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:50:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.808552727s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.329530916s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:50:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.329676004s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.783926913s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:50:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.783961025s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.372423983s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:49:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.37245452s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.741366192s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:48:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.741396801s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.388575611s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:48:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.388605763s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.884697595s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:48:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.884728143s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.648515153s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:47:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.648545708s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.560032411s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:47:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.560065234s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..............X............................................] duration: 2.74008144s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:47:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.740115404s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.360460236s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:46:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.360558672s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X..............X...........................................] duration: 2.950439903s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:46:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.950473622s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.338329289s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:46:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.33849006s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X..............X..........................................] duration: 2.648453962s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:45:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.648481199s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.36566142s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:45:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.365743385s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.386336172s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:45:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.386367598s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.431682868s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:44:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.431777096s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X..............X.........................................] duration: 2.631261636s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:44:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.63128266s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..............X........................................] duration: 2.793660857s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:43:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.793699837s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.482246988s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:43:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.482274144s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..............X.......................................] duration: 2.723776454s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:42:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723819807s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.303215332s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:42:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.303248864s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X..............X......................................] duration: 2.718432752s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:42:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.718527067s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.330786936s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:41:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.330814358s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X..............X.....................................] duration: 2.719739178s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:41:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.719848684s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.343409686s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:41:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.343441713s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..............X....................................] duration: 2.756512745s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:40:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.75654715s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.334001594s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:40:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.334028738s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X..............X...................................] duration: 2.719438385s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:40:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.719461871s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.359338064s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:39:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.359367953s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..............X..................................] duration: 2.95705792s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:39:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.95709112s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.451587171s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:39:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.451619188s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.388317636s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:38:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.388346672s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X..............X.................................] duration: 2.747831728s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:37:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.74786083s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X..............X................................] duration: 2.87302572s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:37:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.873060892s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.538144767s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:37:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.538193803s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X..............X...............................] duration: 2.805433826s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:36:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.805463111s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X..............X..............................] duration: 2.796816688s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:36:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.796857844s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.472398657s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:36:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.472432115s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)