Orbiter History

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXX........................] duration: 368.318786ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:57:13 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 368.340274ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXX.......................] duration: 356.464296ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:56:49 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 356.489764ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXX......................] duration: 343.631302ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:55:52 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 343.661996ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXX.....................] duration: 343.889987ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:55:09 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 343.91169ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXX....................] duration: 357.83778ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:54:41 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 357.937875ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXX...................] duration: 364.000868ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:54:24 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 364.024936ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXX..................] duration: 361.970145ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:53:50 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 361.999618ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXXX.................] duration: 347.850814ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:53:09 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 347.876583ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXX................] duration: 355.720595ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:52:47 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 355.736237ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXX...............] duration: 353.101175ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:51:50 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 353.125689ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXX..............] duration: 352.811528ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:50:50 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 352.838203ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [..................................XXXXXXXXXXXXX.............] duration: 364.421519ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:49:54 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 364.449418ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [...................................XXXXXXXXXXXXX............] duration: 359.417718ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:48:47 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 359.443534ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXX...........] duration: 345.008271ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:47:59 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 345.050395ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXX..........] duration: 359.719494ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:47:12 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 359.749308ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXX.........] duration: 344.295076ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:46:21 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 344.318618ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXX........] duration: 351.613182ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:46:04 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 351.691756ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXX.......] duration: 351.039061ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:45:18 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 351.062172ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXX......] duration: 354.238551ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:44:53 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 354.282025ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXX.....] duration: 351.001302ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:44:24 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 351.024366ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXX....] duration: 354.188707ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:43:32 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 354.218612ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXX...] duration: 371.154831ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:43:07 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 371.18099ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXX..] duration: 351.270012ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:41:53 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 351.293705ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXX.] duration: 351.84642ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:41:11 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 351.872302ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration: 120.46711ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/3a14132d01ff0ac7 FAIL (2026-03-12 02:40:30 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 120.493233ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration: 116.36194ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/79d86513533edf46 FAIL (2026-03-12 02:39:29 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 116.446643ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 117.032889ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/549a7a5b1201e2c4 FAIL (2026-03-12 02:38:50 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 117.05296ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 125.606766ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/720a8ae9b7076c30 FAIL (2026-03-12 02:37:55 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 125.631962ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 139.24709ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/25f2bba9ed677c1b FAIL (2026-03-12 02:37:19 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 139.264179ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 118.434789ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/78487f8a64b554c0 FAIL (2026-03-12 02:36:26 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 118.457536ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 115.715569ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/2254825602fdf9ca FAIL (2026-03-12 02:35:46 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 115.742731ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 118.435286ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/11311e50d2b57282 FAIL (2026-03-12 02:35:14 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 118.464364ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 117.332494ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/119aed0d86be11d1 FAIL (2026-03-12 02:34:41 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 117.361446ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 114.766182ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/6b194309eb628c54 FAIL (2026-03-12 02:33:34 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 114.815928ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 133.675563ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/441748028a055b39 FAIL (2026-03-12 02:32:47 UTC) Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 133.697597ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 116.727641ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/436c2a9a62be4d56 FAIL (2026-03-12 02:31:52 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 116.747495ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 116.515478ms target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/1359fb24fe17f021 FAIL (2026-03-12 02:31:37 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: connect: connection refused Duration: 116.541938ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.900747902s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:19:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.900776216s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.113645401s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:18:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.113672032s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.1757702s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:17:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.175802359s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.148660598s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:17:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.148735409s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.031405227s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:16:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.031434941s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 3.083648162s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:16:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.083694107s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.894621721s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:15:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.894720447s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 3.070578687s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:14:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.070607284s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.994815623s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:13:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.994839532s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.937304884s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:12:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.937330456s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.928824527s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:11:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.928867698s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.94207306s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:11:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.94210118s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 3.058069798s trace: https://jaeger.dev.storj.io/trace/174b7068acd9c74d FAIL (2026-03-12 01:10:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 10837 (32h20m37.501980439s) [upload=31037]: Uploading segments... Mar 12 00:31:34.486776050 (32h20m37.502445657s) [upload=31037]: Got next segment. Inline: false Mar 12 00:31:34.486855931 (32h20m37.502525535s) [upload=31037]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 12 00:31:34.486862930 (32h20m37.502532538s) [upload=31037]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 12 00:31:34.602695736 (32h20m37.618365349s) [seg_pos={0 0}, upload=31037]: Begin upload segment... Mar 12 00:31:34.602763613 (32h20m37.618433214s) [seg_pos={0 0}, upload=31037]: Done begin upload segment. Mar 12 00:31:34.602822074 (32h20m37.618491684s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.602842924 (32h20m37.618512523s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.603681917 (32h20m37.619351527s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.604424128 (32h20m37.620093734s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605011842 (32h20m37.620681449s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.605528765 (32h20m37.621198373s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606168019 (32h20m37.621837625s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.606859614 (32h20m37.622529223s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607454731 (32h20m37.623124341s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.607930410 (32h20m37.623600012s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.609131954 (32h20m37.624801562s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610330433 (32h20m37.626000044s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.610902935 (32h20m37.626572544s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.612789464 (32h20m37.628459074s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.613671297 (32h20m37.629340914s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.615326520 (32h20m37.630996128s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.618326641 (32h20m37.633996248s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:34.619644361 (32h20m37.635313972s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Uploading piece... Mar 12 00:31:35.179232447 (32h20m38.194902033s) [upload=31037]: Next returned nil segment Mar 12 00:31:35.179255069 (32h20m38.194924673s) [upload=31037]: Waiting for error group managing segments... Mar 12 00:31:35.324345351 (32h20m38.34001496s) [noise=true , address=145.79.227.11:4748 , piece_id=ANRQUH4Q6U76CKX5IJNPB4DT5ZWY2Z6DL7M445CTAMCZY6TPEBIQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.329514593 (32h20m38.345184211s) [noise=true , address=145.79.227.17:4984 , piece_id=6OY4DUI4GNEYOL4YGT2DW7HCZJ5LAA73COBG7BOQ3SDBNJIJN4KA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.332335907 (32h20m38.348005511s) [noise=true , address=45.91.116.10:4101 , piece_id=4CLKQAD47CVND7FENO6QCNB6TSJWDL7IKPVZKB5UC23GQH4V7HAA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.347415595 (32h20m38.363085195s) [noise=true , address=145.79.227.16:4928 , piece_id=374MLV3TYE526GE3SA4H4C5VASLIR5F3CGVR26BL6UYXI2JEX2RA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.683227566 (32h20m38.698897167s) [noise=true , address=167.17.72.69:4724 , piece_id=NICLUZ72ZUDOVJKWCPBDK4ZSSKGZVJ3Y3MAZL2ICCCCOMDM3734Q, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.689845167 (32h20m38.705514768s) [noise=true , address=167.17.72.71:4809 , piece_id=2VMRO3MCIVCWI5DRUONAT7XHVNJWMKP6UCVPFNXF3CQPGP2D5SFQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.698339628 (32h20m38.714009233s) [noise=true , address=167.17.72.68:4657 , piece_id=ZO4UJRKHIFS5IHSQ6PKTZ6AJLLG6BC3DQT5HC3OIO6UPWNP7B43A, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.838364650 (32h20m38.854034259s) [noise=true , address=193.149.164.68:4033 , piece_id=ZHFB4E72IZ4SDFOXKXKIFVBYWZ6L52WSASVEV55LL5GOCXS3I3DA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.859483214 (32h20m38.87515283s) [noise=true , address=64.49.13.138:4482 , piece_id=AS7MWR7GBLRJNHSDGY5OVWCY77IKVW2SVHFTVBZSQUCWRQZMBIZA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.860550874 (32h20m38.876220478s) [noise=true , address=193.149.164.70:4118 , piece_id=34MVMVHDGATXPQIQZ2WVBUJYP5NS35TWOMBU7X5LAUNXRZRXOLHQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.870706156 (32h20m38.886375746s) [noise=true , address=193.149.164.66:4977 , piece_id=VXZEPOAY4KXDW3BUCFHWQT7PAEU5WL2BOYF7KUYRI2V72NQVWAFA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:35.894591310 (32h20m38.910260911s) [noise=true , address=193.149.164.71:4291 , piece_id=EWQTPEA7C6BSMOJJZVFUE3TBF7WF2SHHAKOL3QKO4CPBZPWL35BA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:31:37.536870602 (32h20m40.552540214s) [noise=true , address=79.127.205.237:4236 , piece_id=3BU6NGWK2B4S6H5HXJSMSM3ZJEDZZFMEPTADQXJLOAZ2G5EYHOUQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: <nil> Mar 12 00:32:34.202030668 (32h21m37.217700274s) [noise=true , address=77.90.31.14:4685 , piece_id=DVFFETGMI7KCULN5L7EWGCT7SFHAXPJ7NH2NEDO6O3LBYYCUEOZQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: write tcp 139.59.144.22:44908->77.90.31.14:4685: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202352883 (32h21m37.218022493s) [noise=true , address=77.90.31.16:4750 , piece_id=TENSMPQBKXM737MG6RMKQJ2JWZF7UFBEAD7VE27DEJ7KR3ZLXDRQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: rpc: dial tcp 77.90.31.16:4750: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202537306 (32h21m37.218206917s) [noise=true , address=77.90.31.19:4846 , piece_id=JY6E6P6FTE7H5DLV5F66AILET4BOAQ37677GPJRARJSHXKZBWVCQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 139.59.144.22:41948->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202626126 (32h21m37.218295733s) [noise=true , address=77.90.31.21:4895 , piece_id=VRQUXW53SGSXBNQRLWZNV3GJWM655MKVWDCV4XUK3GW34CX75PVQ, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.202960912 (32h21m37.218630519s) [noise=true , address=77.90.31.18:4826 , piece_id=U6ZYNCYOHPC4UDLETIDEDOICOT3MAUVNBNK3VXADV2N5Y4PFSXNA, seg_pos={0 0}, upload=31037]: Done uploading piece. err: ecclient: upload failed (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ, address:77.90.31.18:4826): protocol: rpc: dial tcp 77.90.31.18:4826: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 12 00:32:34.203006347 (32h21m37.218675939s) [seg_pos={0 0}, upload=31037]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 12 00:32:34.306147527 (32h21m37.321817139s) [upload=31037]: Done uploading segments... Mar 12 00:32:34.306191442 (32h21m37.321861053s) [upload=31037]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.058099829s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)