Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 22 out of 60 is failed (threshold=6) [......X........................X.X.X.X...X.X.XXXXXXXXXXXXXXX] duration: 5.001091921s trace: https://jaeger.dev.storj.io/trace/77d580c2c96ff591 FAIL (2026-04-18 00:31:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001182339s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 1m0.005140374s trace: https://jaeger.dev.storj.io/trace/7b2e6853150fa97a FAIL (2026-04-18 00:31:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ, Piece ID: XH4PAMRBIYQSWGJNPAPH4TV4KMIIMR3AJNJ5M6PF5IVXJRKPJ4FA) context deadline exceeded; piecestore: (Node ID: 121QiUDxAr8dicmqP6QFfiGCCoHxXBqwp7WTtGMoBMHKHX4krG2, Piece ID: KJGGMYLYSFEN2E77E5FYX3CYTVWCS3IF3TEUCRNZQ7GSCDRV55FA) context deadline exceeded; piecestore: (Node ID: 12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, Piece ID: IBUIFBASXLLE3WROQBIJWUYFPWVXXONL7QUUDH6M3RGQRGM6VM7Q) context deadline exceeded ======LOGS====== 984 , piece_id=YQJUMZ4TRA2HLMZ44PTHO37NVARVXLDEE5VHMMLKO6OY7ZJJE26Q, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.803459517 (248h13m54.39757077s) [noise=true , address=145.79.227.35:4503 , piece_id=WFPDDQ77MOJZHOJ3NEKTYLMKE5CT4CY5L47WMFJLCBZNCSXMOINQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.807453330 (248h13m54.401564629s) [noise=true , address=45.91.116.4:4943 , piece_id=RWMZUNRZIRKBFFJXXZCPMHAD4FCK2EZOPHQ6QHGFXN6UR65ZXBRQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.807829355 (248h13m54.401940589s) [noise=true , address=167.17.72.71:4791 , piece_id=MD7D5NKIVPGC6MJMZ4SMEH6B67UU4XUK7MFOSRYYI354KGRKIQIA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.809771517 (248h13m54.403882752s) [noise=true , address=167.17.72.69:4741 , piece_id=GOXD47LTGPGDVVA476L5D24QV7R2XRJAINOPAJGZI5WB6E247IFQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.811499996 (248h13m54.405611294s) [noise=true , address=193.149.164.71:4319 , piece_id=KJGGMYLYSFEN2E77E5FYX3CYTVWCS3IF3TEUCRNZQ7GSCDRV55FA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.812526241 (248h13m54.406637488s) [noise=true , address=145.79.227.44:4217 , piece_id=DSX336ULBECKPVOA7FH2DPOGXUUR3UZKCKKHADPPSWSXXQQ5T5XQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.814983479 (248h13m54.409094721s) [noise=true , address=77.90.31.17:4776 , piece_id=XH4PAMRBIYQSWGJNPAPH4TV4KMIIMR3AJNJ5M6PF5IVXJRKPJ4FA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.815687143 (248h13m54.409798447s) [noise=true , address=145.79.227.38:4996 , piece_id=WT77BQ56XVJOEIFXCWWZOKACE6PEZBYGKBU6TSB6KOV22MCELTJA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.817626053 (248h13m54.411737286s) [noise=true , address=167.17.72.68:4656 , piece_id=IBUIFBASXLLE3WROQBIJWUYFPWVXXONL7QUUDH6M3RGQRGM6VM7Q, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.818420640 (248h13m54.412531877s) [noise=true , address=145.79.227.41:4114 , piece_id=Q7XKEDA5HDGBPQPJ7GRPAJWE427OCNFL3IACJUULDHAFDTQXUFOQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.820323722 (248h13m54.414434958s) [noise=true , address=167.17.72.70:4776 , piece_id=UAZKX3SOAUJMEUE37SAUYJ5M6SVCDVMQS75MSROFR5NNI7IK5SXA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.821712408 (248h13m54.415823641s) [noise=true , address=145.79.227.31:4810 , piece_id=GGDL53HQ3NQOYQB3CLSK37JRFLG42ENV7OEOH6S4NFKQX7SNSZYA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.823533708 (248h13m54.41764495s) [noise=true , address=145.79.227.43:4177 , piece_id=SN5XEGBHPGJ3S2A5YP6JIPFX3C3J3NEM7FPSUIBF4O7BXFO564IQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.825093673 (248h13m54.419204906s) [noise=true , address=145.79.227.11:4746 , piece_id=HG6LWE57QUMOTH64NKRPJRPEYM4DEK56O2KETEBXZ6KAGYXRRHWQ, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:43.826462512 (248h13m54.420573741s) [noise=true , address=145.79.227.33:4876 , piece_id=OJR3OMENUSCVDPNMFOZKT5OV5AKIH6OIZ54UU6HFUN6ZUGZTO2NA, seg_pos={0 0}, upload=238655]: Uploading piece... Apr 18 00:30:44.393450726 (248h13m54.987561973s) [upload=238655]: Next returned nil segment Apr 18 00:30:44.393469014 (248h13m54.987580266s) [upload=238655]: Waiting for error group managing segments... Apr 18 00:30:44.548842674 (248h13m55.14295392s) [noise=true , address=145.79.227.35:4503 , piece_id=WFPDDQ77MOJZHOJ3NEKTYLMKE5CT4CY5L47WMFJLCBZNCSXMOINQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:44.557320934 (248h13m55.151432185s) [noise=true , address=45.91.116.4:4943 , piece_id=RWMZUNRZIRKBFFJXXZCPMHAD4FCK2EZOPHQ6QHGFXN6UR65ZXBRQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:44.613268496 (248h13m55.207379751s) [noise=true , address=145.79.227.41:4114 , piece_id=Q7XKEDA5HDGBPQPJ7GRPAJWE427OCNFL3IACJUULDHAFDTQXUFOQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:44.791782390 (248h13m55.385893645s) [noise=true , address=45.91.116.13:4180 , piece_id=2STSYPHSFO2OUGVW7CTGSCUJIWPECGXXFZ2CJ4652NB4JYY3SEOQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:45.058335803 (248h13m55.652447035s) [noise=true , address=193.149.164.71:4319 , piece_id=KJGGMYLYSFEN2E77E5FYX3CYTVWCS3IF3TEUCRNZQ7GSCDRV55FA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:45.066995106 (248h13m55.661106358s) [noise=true , address=193.149.164.66:4984 , piece_id=YQJUMZ4TRA2HLMZ44PTHO37NVARVXLDEE5VHMMLKO6OY7ZJJE26Q, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:53.020639647 (248h14m3.614750887s) [noise=true , address=77.90.31.17:4776 , piece_id=XH4PAMRBIYQSWGJNPAPH4TV4KMIIMR3AJNJ5M6PF5IVXJRKPJ4FA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:30:54.062621752 (248h14m4.656733004s) [noise=true , address=145.79.227.31:4810 , piece_id=GGDL53HQ3NQOYQB3CLSK37JRFLG42ENV7OEOH6S4NFKQX7SNSZYA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:08.142272746 (248h14m18.736384006s) [noise=true , address=145.79.227.43:4177 , piece_id=SN5XEGBHPGJ3S2A5YP6JIPFX3C3J3NEM7FPSUIBF4O7BXFO564IQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:08.815654964 (248h14m19.40976621s) [noise=true , address=167.17.72.68:4656 , piece_id=IBUIFBASXLLE3WROQBIJWUYFPWVXXONL7QUUDH6M3RGQRGM6VM7Q, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:14.315332800 (248h14m24.909444041s) [noise=true , address=167.17.72.71:4791 , piece_id=MD7D5NKIVPGC6MJMZ4SMEH6B67UU4XUK7MFOSRYYI354KGRKIQIA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:24.237407802 (248h14m34.831519058s) [noise=true , address=167.17.72.70:4776 , piece_id=UAZKX3SOAUJMEUE37SAUYJ5M6SVCDVMQS75MSROFR5NNI7IK5SXA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:26.356707685 (248h14m36.950818926s) [noise=true , address=145.79.227.38:4996 , piece_id=WT77BQ56XVJOEIFXCWWZOKACE6PEZBYGKBU6TSB6KOV22MCELTJA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:37.702982141 (248h14m48.297093384s) [noise=true , address=145.79.227.13:4823 , piece_id=C37NZYHIHAS4OMXKAISM6PDK4KLQANXWSLNN3LPFDJPL3AEG4JIA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: <nil> Apr 18 00:31:37.703012239 (248h14m48.297123488s) [seg_pos={0 0}, upload=238655]: Satisfied cohort requirements after 14 pieces Apr 18 00:31:37.703687276 (248h14m48.297798525s) [noise=true , address=167.17.72.69:4741 , piece_id=GOXD47LTGPGDVVA476L5D24QV7R2XRJAINOPAJGZI5WB6E247IFQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HYRP7L7mgb4hPiTB2HxREsebpufcD1yN3wR6rMxTBnk6a5EsT): protocol: expected piece hash; context canceled; EOF Apr 18 00:31:37.703709731 (248h14m48.297820981s) [noise=true , address=167.17.72.69:4741 , piece_id=GOXD47LTGPGDVVA476L5D24QV7R2XRJAINOPAJGZI5WB6E247IFQ, seg_pos={0 0}, upload=238655]: Long tail cancellation due to optimal threshold Apr 18 00:31:37.704446979 (248h14m48.298558221s) [noise=true , address=145.79.227.44:4217 , piece_id=DSX336ULBECKPVOA7FH2DPOGXUUR3UZKCKKHADPPSWSXXQQ5T5XQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bw9V8UMi7pFxqJ8fh22x5ZPmtJUJyJGw8hD9NhQcfHdfx4cZj): protocol: rpc: dial tcp 145.79.227.44:4217: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:31:37.704460919 (248h14m48.298572169s) [noise=true , address=145.79.227.44:4217 , piece_id=DSX336ULBECKPVOA7FH2DPOGXUUR3UZKCKKHADPPSWSXXQQ5T5XQ, seg_pos={0 0}, upload=238655]: Long tail cancellation due to optimal threshold Apr 18 00:31:37.704988481 (248h14m48.299099732s) [noise=true , address=145.79.227.33:4876 , piece_id=OJR3OMENUSCVDPNMFOZKT5OV5AKIH6OIZ54UU6HFUN6ZUGZTO2NA, seg_pos={0 0}, upload=238655]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: read tcp 139.59.144.22:47828->145.79.227.33:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:31:37.704999575 (248h14m48.299110824s) [noise=true , address=145.79.227.33:4876 , piece_id=OJR3OMENUSCVDPNMFOZKT5OV5AKIH6OIZ54UU6HFUN6ZUGZTO2NA, seg_pos={0 0}, upload=238655]: Long tail cancellation due to optimal threshold Apr 18 00:31:37.705218010 (248h14m48.299329261s) [noise=true , address=145.79.227.11:4746 , piece_id=HG6LWE57QUMOTH64NKRPJRPEYM4DEK56O2KETEBXZ6KAGYXRRHWQ, seg_pos={0 0}, upload=238655]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kG5A9wsX3aLNqze39cw3hYu9wmVRi6Wftqazox4xK3aeKjs7e): protocol: read tcp 139.59.144.22:39222->145.79.227.11:4746: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:31:37.705236344 (248h14m48.29934759s) [noise=true , address=145.79.227.11:4746 , piece_id=HG6LWE57QUMOTH64NKRPJRPEYM4DEK56O2KETEBXZ6KAGYXRRHWQ, seg_pos={0 0}, upload=238655]: Long tail cancellation due to optimal threshold Apr 18 00:31:37.705272686 (248h14m48.29938393s) [seg_pos={0 0}, upload=238655]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 18 00:31:37.705382340 (248h14m48.299493586s) [upload=238655]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 18 00:31:37.705388740 (248h14m48.299499989s) [upload=238655]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 18 00:31:37.840120155 (248h14m48.434231396s) [upload=238655]: Done uploading segments... Apr 18 00:31:37.840142406 (248h14m48.434253647s) [upload=238655]: Upload finished. err: <nil> Duration: 1m0.005157771s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [......X...X....................................X....X..X..X.] duration: 15.8369521s trace: https://jaeger.dev.storj.io/trace/5ad367c0f7a64c08 FAIL (2026-04-18 00:31:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.836989727s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.......X...X....................................X....X..X..X] duration: 1m0.002114821s trace: https://jaeger.dev.storj.io/trace/5ad367c0f7a64c08 FAIL (2026-04-18 00:31:06 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.002146539s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 21 out of 60 is failed (threshold=6) [.......X........................X.X.X.X...X.X.XXXXXXXXXXXXXX] duration: 5.000780094s trace: https://jaeger.dev.storj.io/trace/6ac5aba09c3bf825 FAIL (2026-04-18 00:31:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000806973s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 20 out of 60 is failed (threshold=6) [........X........................X.X.X.X...X.X.XXXXXXXXXXXXX] duration: 5.001157673s trace: https://jaeger.dev.storj.io/trace/ada25b418d01c2d FAIL (2026-04-18 00:30:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00149434s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.146216813s trace: https://jaeger.dev.storj.io/trace/638026f8552fde8e FAIL (2026-04-18 00:30:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== :43.439883522 (248h12m54.033994774s) [seg_pos={0 0}, upload=238637]: Begin upload segment... Apr 18 00:29:43.439953582 (248h12m54.03406483s) [seg_pos={0 0}, upload=238637]: Done begin upload segment. Apr 18 00:29:43.440153158 (248h12m54.03426441s) [noise=true , address=145.79.227.40:4079 , piece_id=W35CVRBSKDMT3XFGGC2DEADGFSU3KDOXIAZFHVHSRZ4DHY4SNTEA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.442398132 (248h12m54.036509386s) [noise=true , address=145.79.227.44:4221 , piece_id=NISXKTUWLAYTVNCUUXN5V5RQ5DKVGLEC27YFAGNXYWL5N7NPKGZA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.443338053 (248h12m54.037449305s) [noise=true , address=77.90.31.12:4624 , piece_id=WLUYXKSKDC542ZGCLNHKK4LYRK2ZGC2WOQF33RMF6Y4ZJEINQNRA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.443925936 (248h12m54.038037189s) [noise=true , address=145.79.227.11:4740 , piece_id=MHSD2PHS77ZFPIOJQ6JIM5MOA2NZSSDPRXZ7EFE7CKPCGAHQA6DQ, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.444607542 (248h12m54.038718796s) [noise=true , address=145.79.227.34:4925 , piece_id=2N2D7S72DPUXNQ6BXOCUM4WDLRROV3U6VGU3LVXDFIKAD5BESJXQ, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.445155047 (248h12m54.039266302s) [noise=true , address=193.149.164.71:4288 , piece_id=MM5XDODNUBJTMOTW6V5HFRJXUUVFOSO2PZIEKNDJSL7AUA6YHPRA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.445662557 (248h12m54.03977381s) [noise=true , address=193.149.164.143:4704 , piece_id=VPIKKATFXFTSUZLO6XESRIHDDFNNUAX5UR7ISH5DQAEZHPMIHPAA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.446237467 (248h12m54.040348718s) [noise=true , address=145.79.227.31:4812 , piece_id=OTDUGNTMRCXMGFGXW7RXGAHDJUDEKDWK6CWS5CQLYJ7OIQ2TXMDA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.446843880 (248h12m54.040955131s) [noise=true , address=193.149.164.66:4993 , piece_id=S6JF4N4XECVS3QMS4YID2MAGL7BGB3NQSXBI3BQQC75JKODXZ6LA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.447439216 (248h12m54.041550459s) [noise=true , address=145.79.227.33:4887 , piece_id=E2EXSQQ7BSJCIVZL7WQPQCLACOUXJBWFKSIQHZ2INYNMPDJOPB3A, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.448920535 (248h12m54.043031785s) [noise=true , address=167.17.72.71:4807 , piece_id=ECXISTXS35BD2RCMMJH65CF32KXSSBVEJ5UNWT2SGSRCOMHVEFRA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.450796291 (248h12m54.044907541s) [noise=true , address=145.79.227.43:4191 , piece_id=QKIJWVX3ZC2ROFUAPDLVHJJRXLCWVIOYZCR6BCB55M77ZRZO4A5A, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.452470294 (248h12m54.046581548s) [noise=true , address=77.90.31.14:4691 , piece_id=VHNWFC77VF3N6257PR7VJ3Z6N2VQ4XZUG4UQXEF6QIDA2ZNLXXZA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.454414463 (248h12m54.048525716s) [noise=true , address=145.79.227.21:4508 , piece_id=HPIF7AMS75WDNM5AQBYTDBPWODRROV3IKNY4D5RNOJOXBHYHINXA, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.459421099 (248h12m54.053532364s) [noise=true , address=145.79.227.13:4820 , piece_id=J4UMAAN44TJ656T26ULVPRN53JDSU2ERC4BOWB6NODXK27DGGBLQ, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.463037271 (248h12m54.057148522s) [noise=true , address=167.17.72.70:4767 , piece_id=62QGMYZ7RBY77ZZ2GX6SHF63KYRQBGRNHVSJEE3FTSDGRPOHXY3Q, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.466409871 (248h12m54.060521124s) [noise=true , address=145.79.227.48:4331 , piece_id=H6EFJ3FWPFIOXKA27KMIX3BJ55TUIT4NVP67SWJOQ6M6CH7A6A2Q, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:43.468914250 (248h12m54.063025503s) [noise=true , address=167.17.72.69:4729 , piece_id=SGHWMFVH64TVA4THYRVWPKNGAQHOQQA3PADTOHZIY4CLERAGJ65A, seg_pos={0 0}, upload=238637]: Uploading piece... Apr 18 00:29:44.000136573 (248h12m54.594247812s) [upload=238637]: Next returned nil segment Apr 18 00:29:44.000158061 (248h12m54.594269315s) [upload=238637]: Waiting for error group managing segments... Apr 18 00:29:44.149496904 (248h12m54.743608159s) [noise=true , address=77.90.31.12:4624 , piece_id=WLUYXKSKDC542ZGCLNHKK4LYRK2ZGC2WOQF33RMF6Y4ZJEINQNRA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:29:44.172460287 (248h12m54.766571533s) [noise=true , address=145.79.227.21:4508 , piece_id=HPIF7AMS75WDNM5AQBYTDBPWODRROV3IKNY4D5RNOJOXBHYHINXA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: storage node overloaded, request limit: 2000 Apr 18 00:29:44.199841877 (248h12m54.793953123s) [noise=true , address=145.79.227.31:4812 , piece_id=OTDUGNTMRCXMGFGXW7RXGAHDJUDEKDWK6CWS5CQLYJ7OIQ2TXMDA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:29:44.202320222 (248h12m54.796431467s) [noise=true , address=145.79.227.48:4331 , piece_id=H6EFJ3FWPFIOXKA27KMIX3BJ55TUIT4NVP67SWJOQ6M6CH7A6A2Q, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:29:44.309490130 (248h12m54.903601376s) [noise=true , address=77.90.31.14:4691 , piece_id=VHNWFC77VF3N6257PR7VJ3Z6N2VQ4XZUG4UQXEF6QIDA2ZNLXXZA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:29:44.761316826 (248h12m55.355428054s) [noise=true , address=193.149.164.66:4993 , piece_id=S6JF4N4XECVS3QMS4YID2MAGL7BGB3NQSXBI3BQQC75JKODXZ6LA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:29:45.813700333 (248h12m56.407811578s) [noise=true , address=167.17.72.69:4729 , piece_id=SGHWMFVH64TVA4THYRVWPKNGAQHOQQA3PADTOHZIY4CLERAGJ65A, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:29:45.819244294 (248h12m56.413355545s) [noise=true , address=193.149.164.143:4704 , piece_id=VPIKKATFXFTSUZLO6XESRIHDDFNNUAX5UR7ISH5DQAEZHPMIHPAA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:1bUVmWsfAfQiPWhDkYRNGhims8TLQqGqvhrZMYugLLTdmLk2xY, address:193.149.164.143:4704): protocol: storage node overloaded, request limit: 2000 Apr 18 00:30:02.047035692 (248h13m12.64114695s) [noise=true , address=145.79.227.43:4191 , piece_id=QKIJWVX3ZC2ROFUAPDLVHJJRXLCWVIOYZCR6BCB55M77ZRZO4A5A, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:30:05.075884906 (248h13m15.669996153s) [noise=true , address=193.149.164.71:4288 , piece_id=MM5XDODNUBJTMOTW6V5HFRJXUUVFOSO2PZIEKNDJSL7AUA6YHPRA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:30:09.903347273 (248h13m20.497458516s) [noise=true , address=167.17.72.71:4807 , piece_id=ECXISTXS35BD2RCMMJH65CF32KXSSBVEJ5UNWT2SGSRCOMHVEFRA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:30:11.514114884 (248h13m22.108226128s) [noise=true , address=145.79.227.40:4079 , piece_id=W35CVRBSKDMT3XFGGC2DEADGFSU3KDOXIAZFHVHSRZ4DHY4SNTEA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:30:37.022927175 (248h13m47.617038432s) [noise=true , address=167.17.72.70:4767 , piece_id=62QGMYZ7RBY77ZZ2GX6SHF63KYRQBGRNHVSJEE3FTSDGRPOHXY3Q, seg_pos={0 0}, upload=238637]: Done uploading piece. err: <nil> Apr 18 00:30:43.039065048 (248h13m53.6331763s) [noise=true , address=145.79.227.13:4820 , piece_id=J4UMAAN44TJ656T26ULVPRN53JDSU2ERC4BOWB6NODXK27DGGBLQ, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:145.79.227.13:4820): protocol: write tcp 139.59.144.22:40026->145.79.227.13:4820: use of closed network connection; write tcp 139.59.144.22:40026->145.79.227.13:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40026->145.79.227.13:4820: use of closed network connection Apr 18 00:30:43.039448512 (248h13m53.633559766s) [noise=true , address=145.79.227.11:4740 , piece_id=MHSD2PHS77ZFPIOJQ6JIM5MOA2NZSSDPRXZ7EFE7CKPCGAHQA6DQ, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:12wgQDbE17gP8c6kbKnNyywSkY8Hk7mchcMaymLBQzPwRsSB8QE, address:145.79.227.11:4740): protocol: rpc: dial tcp 145.79.227.11:4740: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:30:43.039464009 (248h13m53.633575237s) [noise=true , address=145.79.227.33:4887 , piece_id=E2EXSQQ7BSJCIVZL7WQPQCLACOUXJBWFKSIQHZ2INYNMPDJOPB3A, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H, address:145.79.227.33:4887): protocol: rpc: dial tcp 145.79.227.33:4887: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:30:43.039687302 (248h13m53.63379854s) [noise=true , address=145.79.227.34:4925 , piece_id=2N2D7S72DPUXNQ6BXOCUM4WDLRROV3U6VGU3LVXDFIKAD5BESJXQ, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:14ZdgenD4m2bMMmaHVyK3YivrzdSnrp72JvMJsk1uecW6KKFjn, address:145.79.227.34:4925): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 00:30:43.039707770 (248h13m53.633819023s) [noise=true , address=145.79.227.44:4221 , piece_id=NISXKTUWLAYTVNCUUXN5V5RQ5DKVGLEC27YFAGNXYWL5N7NPKGZA, seg_pos={0 0}, upload=238637]: Done uploading piece. err: ecclient: upload failed (node:1ssFiXk5oKTgnVMJ5TBJuSXuD1D2C46gT2hcY6yaDxf8fL1cjm, address:145.79.227.44:4221): protocol: context deadline exceeded; context deadline exceeded Apr 18 00:30:43.039769655 (248h13m53.633880899s) [seg_pos={0 0}, upload=238637]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Apr 18 00:30:43.169710956 (248h13m53.763822203s) [upload=238637]: Done uploading segments... Apr 18 00:30:43.177279070 (248h13m53.771390321s) [upload=238637]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.146249774s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [.........X........................X.X.X.X...X.X.XXXXXXXXXXXX] duration: 5.000572886s trace: https://jaeger.dev.storj.io/trace/5ff96bcd967ac5d3 FAIL (2026-04-18 00:30:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000685943s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [........X...X....................................X....X..X..] duration: 39.460845358s trace: https://jaeger.dev.storj.io/trace/d8d4d62f50588aa FAIL (2026-04-18 00:29:49 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 39.460875934s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [..........X........................X.X.X.X...X.X.XXXXXXXXXXX] duration: 5.002051921s trace: https://jaeger.dev.storj.io/trace/c6f71c653bc1ed3 FAIL (2026-04-18 00:29:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002078455s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.118749091s trace: https://jaeger.dev.storj.io/trace/5b749dd1b941bb80 FAIL (2026-04-18 00:29:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== starting upload Apr 18 00:28:43.050903565 (248h11m53.645014801s) [upload=238623]: Uploading segments... Apr 18 00:28:43.051180925 (248h11m53.645292163s) [upload=238623]: Got next segment. Inline: false Apr 18 00:28:43.051251478 (248h11m53.645362733s) [upload=238623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 00:28:43.051259137 (248h11m53.645370383s) [upload=238623]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 00:28:43.163218526 (248h11m53.757329772s) [seg_pos={0 0}, upload=238623]: Begin upload segment... Apr 18 00:28:43.163298281 (248h11m53.757409512s) [seg_pos={0 0}, upload=238623]: Done begin upload segment. Apr 18 00:28:43.163342871 (248h11m53.757454125s) [noise=true , address=193.149.164.143:4698 , piece_id=QLTSSHMN2HW5Q367GPDV3VVNZUDA6KB46IXGPI7RXLBXIDGMGFIA, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.163375141 (248h11m53.757486384s) [noise=true , address=77.90.31.17:4788 , piece_id=UJTTVPLK2KFTUMU5HPRLTOJAWEYWZ7AR7NCM6BH6JGG3TD2RL3QA, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.164164228 (248h11m53.758275477s) [noise=true , address=145.79.227.13:4824 , piece_id=AZXSN3HVFR3TT3EZS74PK6Z7REXZAZX7ZHJWHEXIYVI7MZJKDWZA, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.164599005 (248h11m53.758710253s) [noise=true , address=167.17.72.69:4732 , piece_id=RQKOEENU5XBNETJVZM5OWBPPYIM3SZZOIVEKKOO4777OEA4DFSJQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.164971317 (248h11m53.75908257s) [noise=true , address=77.90.31.14:4691 , piece_id=UEMURI5MOW56342QACAB7XOQSXWDCHNBMNEES35MNCWPSRYR34VQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.165603226 (248h11m53.759714479s) [noise=true , address=64.49.13.170:4719 , piece_id=35N5YRTPAO766YV3XZKYW7CPHMFUCCDGAIL4NPGJGVDYS2U6ST7Q, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.166014152 (248h11m53.760125405s) [noise=true , address=145.79.227.11:4755 , piece_id=EUJXW27YKBW4JBBKNPUJT42WEDNAXSC2ABR5LLGFJNU35YMYRVNQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.166580154 (248h11m53.760691515s) [noise=true , address=193.149.164.71:4296 , piece_id=L3BD3447ZVKGGRRABGRJ6NSIZH27CZK6NGDYYTZKZVBDN5QVZDBQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.167798422 (248h11m53.761909673s) [noise=true , address=193.149.164.66:4992 , piece_id=SXI6EXOUCPDSXJ6VEDO4ZF5HWWGR5W6624TSMCHPXZK5MUBQVQ2Q, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.168343576 (248h11m53.762454803s) [noise=true , address=145.79.227.41:4104 , piece_id=KG62G6EPM4LHFHHMYLHFE7ANRDVIIM6QLQPTWNFEBLGZBXGPJ76A, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.168820948 (248h11m53.762932199s) [noise=true , address=145.79.227.34:4911 , piece_id=Z2DQ7ECQLG2FQCKVSE5MOZMHGT33JM4FXUGLEG3D3DGFWCBL2WUQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.169393288 (248h11m53.763504539s) [noise=true , address=145.79.227.31:4823 , piece_id=PI7ZHG6PDQZOMOGVYL5DASYP54FAIDFJD7MTWBWJ2R2RRKHXPF6A, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.170113086 (248h11m53.764224327s) [noise=true , address=145.79.227.28:4738 , piece_id=66DO4VJHZUJQ342OSW74Q6RGELVVJNVHMAKBPC2K2EBWFCARLYWA, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.170336692 (248h11m53.76444794s) [noise=true , address=145.79.227.40:4075 , piece_id=VQYCX4FOCCAARO7ZLOH55HCE3CTAJMU4LZ6A4MGY5L4QL2VNBRSA, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.170932467 (248h11m53.765043721s) [noise=true , address=167.17.72.70:4756 , piece_id=ZMP2A2PTVMKWC6SCVYOBUKOGCKN2II2JTCEGNT2ZLLFUOI6PD3GA, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.171405279 (248h11m53.765516529s) [noise=true , address=145.79.227.5:4249 , piece_id=CJ5YECC2KO7JNZLEZMI6ZQIENCERJC62R7N7VGQ5UHY43PI25C5Q, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.171724475 (248h11m53.765835718s) [noise=true , address=145.79.227.6:4273 , piece_id=7WXNJGYLLA7JLWVVXSTEDDJHR6JYIEQZP4QP6YYMFLOF53ZR7ZKQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.172224198 (248h11m53.766335462s) [noise=true , address=45.91.116.14:4210 , piece_id=W32SDNC7TUDRYRI2LMFJLB5IOSGLROSX3TH2R4VCSRUAATYRBMHQ, seg_pos={0 0}, upload=238623]: Uploading piece... Apr 18 00:28:43.724574880 (248h11m54.318686121s) [upload=238623]: Next returned nil segment Apr 18 00:28:43.724592334 (248h11m54.318703577s) [upload=238623]: Waiting for error group managing segments... Apr 18 00:28:43.837243597 (248h11m54.431354849s) [noise=true , address=193.149.164.143:4698 , piece_id=QLTSSHMN2HW5Q367GPDV3VVNZUDA6KB46IXGPI7RXLBXIDGMGFIA, seg_pos={0 0}, upload=238623]: Done uploading piece. err: ecclient: upload failed (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi, address:193.149.164.143:4698): protocol: storage node overloaded, request limit: 2000 Apr 18 00:28:43.873759987 (248h11m54.467871228s) [noise=true , address=45.91.116.14:4210 , piece_id=W32SDNC7TUDRYRI2LMFJLB5IOSGLROSX3TH2R4VCSRUAATYRBMHQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:43.882722571 (248h11m54.476833814s) [noise=true , address=145.79.227.5:4249 , piece_id=CJ5YECC2KO7JNZLEZMI6ZQIENCERJC62R7N7VGQ5UHY43PI25C5Q, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:44.047828802 (248h11m54.64194005s) [noise=true , address=145.79.227.28:4738 , piece_id=66DO4VJHZUJQ342OSW74Q6RGELVVJNVHMAKBPC2K2EBWFCARLYWA, seg_pos={0 0}, upload=238623]: Done uploading piece. err: ecclient: upload failed (node:1E3hj2265uPVRxbFiXEbkQsuDrfMe7HbRzxoYLfHNVm4vQJMQd, address:145.79.227.28:4738): protocol: storage node overloaded, request limit: 2000 Apr 18 00:28:44.078380951 (248h11m54.67249219s) [noise=true , address=145.79.227.41:4104 , piece_id=KG62G6EPM4LHFHHMYLHFE7ANRDVIIM6QLQPTWNFEBLGZBXGPJ76A, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:44.101413563 (248h11m54.695524789s) [noise=true , address=145.79.227.6:4273 , piece_id=7WXNJGYLLA7JLWVVXSTEDDJHR6JYIEQZP4QP6YYMFLOF53ZR7ZKQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:44.612800519 (248h11m55.206911758s) [noise=true , address=64.49.13.170:4719 , piece_id=35N5YRTPAO766YV3XZKYW7CPHMFUCCDGAIL4NPGJGVDYS2U6ST7Q, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:44.704065305 (248h11m55.298176544s) [noise=true , address=77.90.31.14:4691 , piece_id=UEMURI5MOW56342QACAB7XOQSXWDCHNBMNEES35MNCWPSRYR34VQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:44.740335873 (248h11m55.334447101s) [noise=true , address=193.149.164.71:4296 , piece_id=L3BD3447ZVKGGRRABGRJ6NSIZH27CZK6NGDYYTZKZVBDN5QVZDBQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:45.902283383 (248h11m56.496394639s) [noise=true , address=193.149.164.66:4992 , piece_id=SXI6EXOUCPDSXJ6VEDO4ZF5HWWGR5W6624TSMCHPXZK5MUBQVQ2Q, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:46.334065471 (248h11m56.928191487s) [noise=true , address=145.79.227.31:4823 , piece_id=PI7ZHG6PDQZOMOGVYL5DASYP54FAIDFJD7MTWBWJ2R2RRKHXPF6A, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:49.686823244 (248h12m0.280934483s) [noise=true , address=145.79.227.40:4075 , piece_id=VQYCX4FOCCAARO7ZLOH55HCE3CTAJMU4LZ6A4MGY5L4QL2VNBRSA, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:51.842223223 (248h12m2.436334464s) [noise=true , address=77.90.31.17:4788 , piece_id=UJTTVPLK2KFTUMU5HPRLTOJAWEYWZ7AR7NCM6BH6JGG3TD2RL3QA, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:28:55.050252992 (248h12m5.644364233s) [noise=true , address=167.17.72.70:4756 , piece_id=ZMP2A2PTVMKWC6SCVYOBUKOGCKN2II2JTCEGNT2ZLLFUOI6PD3GA, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:29:17.290755627 (248h12m27.884866874s) [noise=true , address=167.17.72.69:4732 , piece_id=RQKOEENU5XBNETJVZM5OWBPPYIM3SZZOIVEKKOO4777OEA4DFSJQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: <nil> Apr 18 00:29:42.762359559 (248h12m53.356470815s) [noise=true , address=145.79.227.13:4824 , piece_id=AZXSN3HVFR3TT3EZS74PK6Z7REXZAZX7ZHJWHEXIYVI7MZJKDWZA, seg_pos={0 0}, upload=238623]: Done uploading piece. err: ecclient: upload failed (node:128RwAx77X1bmYyNBtGGMbUUKtvpZjtSBRK2M7AKtebEP4TY4wm, address:145.79.227.13:4824): protocol: write tcp 139.59.144.22:59438->145.79.227.13:4824: use of closed network connection; write tcp 139.59.144.22:59438->145.79.227.13:4824: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59438->145.79.227.13:4824: use of closed network connection Apr 18 00:29:42.762700217 (248h12m53.356811465s) [noise=true , address=145.79.227.11:4755 , piece_id=EUJXW27YKBW4JBBKNPUJT42WEDNAXSC2ABR5LLGFJNU35YMYRVNQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: ecclient: upload failed (node:1NesDEUEmNTHsmSYb1V6esyDAryke6A7NmRnPE6mwPknTfUFF3, address:145.79.227.11:4755): protocol: context deadline exceeded; context deadline exceeded Apr 18 00:29:42.762872527 (248h12m53.356983778s) [noise=true , address=145.79.227.34:4911 , piece_id=Z2DQ7ECQLG2FQCKVSE5MOZMHGT33JM4FXUGLEG3D3DGFWCBL2WUQ, seg_pos={0 0}, upload=238623]: Done uploading piece. err: ecclient: upload failed (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ, address:145.79.227.34:4911): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 00:29:42.762948077 (248h12m53.357059319s) [seg_pos={0 0}, upload=238623]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 00:29:42.878305514 (248h12m53.472416758s) [upload=238623]: Done uploading segments... Apr 18 00:29:42.878351018 (248h12m53.472462265s) [upload=238623]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.118768725s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 17 out of 60 is failed (threshold=6) [...........X........................X.X.X.X...X.X.XXXXXXXXXX] duration: 5.001672365s trace: https://jaeger.dev.storj.io/trace/269178ad1fd0a58e FAIL (2026-04-18 00:28:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00171819s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.105182195s trace: https://jaeger.dev.storj.io/trace/213a4cc0d6d5a779 FAIL (2026-04-18 00:28:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== arting upload Apr 18 00:27:42.785366761 (248h10m53.379478014s) [upload=238609]: Done starting upload Apr 18 00:27:42.785646428 (248h10m53.379757661s) [upload=238609]: Uploading segments... Apr 18 00:27:42.785840988 (248h10m53.379952236s) [upload=238609]: Got next segment. Inline: false Apr 18 00:27:42.785956290 (248h10m53.380067536s) [upload=238609]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 00:27:42.785965193 (248h10m53.38007644s) [upload=238609]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 00:27:42.897124526 (248h10m53.491235777s) [seg_pos={0 0}, upload=238609]: Begin upload segment... Apr 18 00:27:42.897201295 (248h10m53.491312541s) [seg_pos={0 0}, upload=238609]: Done begin upload segment. Apr 18 00:27:42.897245480 (248h10m53.491356731s) [noise=true , address=167.17.72.70:4749 , piece_id=KGECD2JEXINZIBKOKYDSKJV5P26TKWSF4LU5DIRUJUA4SJA3OBKA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.897302652 (248h10m53.491413908s) [noise=true , address=145.79.227.49:4365 , piece_id=ENFN54XX5NSPBKT2KHTILHC6LAVPLYBS5N55OZ6X6V2T7EVE4HDQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.898063815 (248h10m53.49217508s) [noise=true , address=145.79.227.21:4508 , piece_id=S2QPXUDK6NXP5CVWYFLLDSGJ36LW7QM7TKPPB7645LXR6R4BNFUA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.898577855 (248h10m53.492689106s) [noise=true , address=77.90.31.12:4624 , piece_id=5QKELAGXON34TF5AMSZZZIOLCBLIUO5LOROETZHT4NPO7D45WRKA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.899038879 (248h10m53.493150126s) [noise=true , address=145.79.227.29:4950 , piece_id=4LLH6NZTEMKZFXP4QS3RXNABVVS2B7MS4VQI23W5YMMAKSDIBEOQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.899507866 (248h10m53.493619109s) [noise=true , address=145.79.227.11:4739 , piece_id=7BEXCTQ5K5V4B5YKZLJKMMFMVH5RHK7QXKZ5UOKO3VI5OY6NQ23Q, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.899908259 (248h10m53.494019511s) [noise=true , address=167.17.72.68:4646 , piece_id=2ZG7RDDV6C3Z3E5ML2FZJOCG5NSSNOFXMAFNJ3ZCSOOZ2FGTYHFQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.900538118 (248h10m53.494649369s) [noise=true , address=145.79.227.44:4219 , piece_id=3HTQT5VRIKMGZ36VISYLWC4OTTBYFTK24VYOJE5QDWM4I64BAJ6Q, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.901016395 (248h10m53.495127642s) [noise=true , address=167.17.72.71:4813 , piece_id=3BM5NHJU7QXBIK3K44GFBN7DROGLS6JPZU6NIA4BDVNZVVALW5EQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.901462745 (248h10m53.495573995s) [noise=true , address=145.79.227.38:4988 , piece_id=QWOHQPIQDECMK7CRKJGKNAYUEMJZFLKH3EP6KQ2DIEAQMYZMCJEQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.902052309 (248h10m53.496163556s) [noise=true , address=193.149.164.71:4294 , piece_id=4MKAXQUURNFRJJ776INX2S2YRBZG3TXIWK5OUDE4KSWDSOXWLRAA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.902576769 (248h10m53.496688017s) [noise=true , address=145.79.227.13:4810 , piece_id=EWWAZD5EHH5XRKDGIMZUQ36AYUUCKOZ55SQQIUWTVZB5T33FAYUA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.903102560 (248h10m53.497213792s) [noise=true , address=145.79.227.16:4939 , piece_id=D2UB5XR3WOCZFEWQDCZOG47JNECN74RGWWI7D6JUGCJFTEGVQFIA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.903500112 (248h10m53.497611359s) [noise=true , address=145.79.227.19:4112 , piece_id=GVHTOMVTGYRES6GV5UMYPRF5J4OLLDIB7YURZ5Z6Z4RVFOTTCQYQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.903893663 (248h10m53.498004905s) [noise=true , address=77.90.31.10:4545 , piece_id=JDQ5JH3Z3EM7FBFLSFJCM44SXBEJECXKIW3YVL3BZWQDKVGLRWFA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.904447438 (248h10m53.498558689s) [noise=true , address=167.17.72.69:4715 , piece_id=ORYZCVLYZRFLLSTAO62B3AKLCLRV2JDA545KBBDUHGO2725JIOBA, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.904882379 (248h10m53.498993623s) [noise=true , address=145.79.227.17:4995 , piece_id=DA3NFHHX74AYB3KI7IIEDWS2IKC6CJBT5G7BMYF32JIPKZMXWZ5Q, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:42.905303176 (248h10m53.499414427s) [noise=true , address=77.90.31.17:4785 , piece_id=VWB5A3V77Q4XM6PNGULRHR3W77LX4SO2QZNUYMMTFXXCLYLIEZCQ, seg_pos={0 0}, upload=238609]: Uploading piece... Apr 18 00:27:43.476307781 (248h10m54.070419015s) [upload=238609]: Next returned nil segment Apr 18 00:27:43.476328284 (248h10m54.070439538s) [upload=238609]: Waiting for error group managing segments... Apr 18 00:27:43.616449808 (248h10m54.210561049s) [noise=true , address=145.79.227.16:4939 , piece_id=D2UB5XR3WOCZFEWQDCZOG47JNECN74RGWWI7D6JUGCJFTEGVQFIA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:43.629401144 (248h10m54.22351239s) [noise=true , address=145.79.227.17:4995 , piece_id=DA3NFHHX74AYB3KI7IIEDWS2IKC6CJBT5G7BMYF32JIPKZMXWZ5Q, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:44.774087397 (248h10m55.36819865s) [noise=true , address=145.79.227.21:4508 , piece_id=S2QPXUDK6NXP5CVWYFLLDSGJ36LW7QM7TKPPB7645LXR6R4BNFUA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: storage node overloaded, request limit: 2000 Apr 18 00:27:46.584157416 (248h10m57.178268645s) [noise=true , address=77.90.31.12:4624 , piece_id=5QKELAGXON34TF5AMSZZZIOLCBLIUO5LOROETZHT4NPO7D45WRKA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:47.207274848 (248h10m57.80138611s) [noise=true , address=77.90.31.10:4545 , piece_id=JDQ5JH3Z3EM7FBFLSFJCM44SXBEJECXKIW3YVL3BZWQDKVGLRWFA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:48.466152151 (248h10m59.060263392s) [noise=true , address=193.149.164.71:4294 , piece_id=4MKAXQUURNFRJJ776INX2S2YRBZG3TXIWK5OUDE4KSWDSOXWLRAA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:49.156163712 (248h10m59.75027496s) [noise=true , address=145.79.227.19:4112 , piece_id=GVHTOMVTGYRES6GV5UMYPRF5J4OLLDIB7YURZ5Z6Z4RVFOTTCQYQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:51.407087407 (248h11m2.001198653s) [noise=true , address=77.90.31.17:4785 , piece_id=VWB5A3V77Q4XM6PNGULRHR3W77LX4SO2QZNUYMMTFXXCLYLIEZCQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:27:51.576781327 (248h11m2.17089257s) [noise=true , address=145.79.227.13:4810 , piece_id=EWWAZD5EHH5XRKDGIMZUQ36AYUUCKOZ55SQQIUWTVZB5T33FAYUA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: ecclient: upload failed (node:12GTWz2fWHLAApibeARUerDvJ9c4AWYRVAvumRxgJwwqCYYJJfg, address:145.79.227.13:4810): protocol: storage node overloaded, request limit: 2000 Apr 18 00:27:58.023169052 (248h11m8.617280297s) [noise=true , address=167.17.72.71:4813 , piece_id=3BM5NHJU7QXBIK3K44GFBN7DROGLS6JPZU6NIA4BDVNZVVALW5EQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:28:01.360805203 (248h11m11.954916451s) [noise=true , address=167.17.72.68:4646 , piece_id=2ZG7RDDV6C3Z3E5ML2FZJOCG5NSSNOFXMAFNJ3ZCSOOZ2FGTYHFQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:28:09.298189522 (248h11m19.892300765s) [noise=true , address=167.17.72.69:4715 , piece_id=ORYZCVLYZRFLLSTAO62B3AKLCLRV2JDA545KBBDUHGO2725JIOBA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:28:10.551735234 (248h11m21.145846479s) [noise=true , address=145.79.227.29:4950 , piece_id=4LLH6NZTEMKZFXP4QS3RXNABVVS2B7MS4VQI23W5YMMAKSDIBEOQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:28:12.578215107 (248h11m23.172326357s) [noise=true , address=145.79.227.38:4988 , piece_id=QWOHQPIQDECMK7CRKJGKNAYUEMJZFLKH3EP6KQ2DIEAQMYZMCJEQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:28:27.723677256 (248h11m38.317788502s) [noise=true , address=167.17.72.70:4749 , piece_id=KGECD2JEXINZIBKOKYDSKJV5P26TKWSF4LU5DIRUJUA4SJA3OBKA, seg_pos={0 0}, upload=238609]: Done uploading piece. err: <nil> Apr 18 00:28:42.492373275 (248h11m53.086484524s) [noise=true , address=145.79.227.44:4219 , piece_id=3HTQT5VRIKMGZ36VISYLWC4OTTBYFTK24VYOJE5QDWM4I64BAJ6Q, seg_pos={0 0}, upload=238609]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:145.79.227.44:4219): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 00:28:42.492665585 (248h11m53.086776832s) [noise=true , address=145.79.227.49:4365 , piece_id=ENFN54XX5NSPBKT2KHTILHC6LAVPLYBS5N55OZ6X6V2T7EVE4HDQ, seg_pos={0 0}, upload=238609]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:28:42.493023710 (248h11m53.087134959s) [noise=true , address=145.79.227.11:4739 , piece_id=7BEXCTQ5K5V4B5YKZLJKMMFMVH5RHK7QXKZ5UOKO3VI5OY6NQ23Q, seg_pos={0 0}, upload=238609]: Done uploading piece. err: ecclient: upload failed (node:1eEbhCXRGArodr2pffqXQxRR8w6u4c6J6auDbsCwe1NH5Wwycd, address:145.79.227.11:4739): protocol: read tcp 139.59.144.22:50526->145.79.227.11:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:28:42.493052566 (248h11m53.087163792s) [seg_pos={0 0}, upload=238609]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 00:28:42.595442381 (248h11m53.189553623s) [upload=238609]: Done uploading segments... Apr 18 00:28:42.595481651 (248h11m53.189592898s) [upload=238609]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.105198655s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.........X...X....................................X....X..X.] duration: 33.724426273s trace: https://jaeger.dev.storj.io/trace/d8d4d62f50588aa FAIL (2026-04-18 00:28:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 33.724459384s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 16 out of 60 is failed (threshold=6) [............X........................X.X.X.X...X.X.XXXXXXXXX] duration: 5.001225069s trace: https://jaeger.dev.storj.io/trace/2b740c97a387e082 FAIL (2026-04-18 00:28:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001249575s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..........X...X....................................X....X..X] duration: 1m0.001960901s trace: https://jaeger.dev.storj.io/trace/d8d4d62f50588aa FAIL (2026-04-18 00:27:58 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.002005789s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.10950666s trace: https://jaeger.dev.storj.io/trace/693a8bd23c0d93b9 FAIL (2026-04-18 00:27:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 65s) [upload=238593]: Starting upload Apr 18 00:26:42.509385856 (248h9m53.1034971s) [upload=238593]: Done starting upload Apr 18 00:26:42.509567164 (248h9m53.103678404s) [upload=238593]: Uploading segments... Apr 18 00:26:42.509897493 (248h9m53.104008734s) [upload=238593]: Got next segment. Inline: false Apr 18 00:26:42.509978470 (248h9m53.104089716s) [upload=238593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 00:26:42.509984060 (248h9m53.104095304s) [upload=238593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 00:26:42.621403236 (248h9m53.215514512s) [seg_pos={0 0}, upload=238593]: Begin upload segment... Apr 18 00:26:42.621506258 (248h9m53.215617503s) [seg_pos={0 0}, upload=238593]: Done begin upload segment. Apr 18 00:26:42.621557390 (248h9m53.21566864s) [noise=true , address=45.91.116.11:4130 , piece_id=PKKVDNCSXMXR7OKLRSTROQEPX36KGUL7KERP6WHK225UHJF62UQQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.621588789 (248h9m53.21570004s) [noise=true , address=145.79.227.11:4737 , piece_id=MRQDYOT6GILDAFSYWB7TSL7SFE47BLZG5PD3RSYOPMYAURGTCFHQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.622310155 (248h9m53.216421405s) [noise=true , address=145.79.227.33:4902 , piece_id=ZCBDDC7H7GVB4XDQ2DLMZT4YT3TKZGMGU4ZNBVVLFNHIPHWOI7DA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.622411310 (248h9m53.21652256s) [noise=true , address=145.79.227.13:4834 , piece_id=PK7KWU5BAGG2X56ICRTUET45DWTQ7IDLSUT2ROSKWBAEKTQHDNLA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.622897004 (248h9m53.217008252s) [noise=true , address=145.79.227.29:4954 , piece_id=A5Q5BLUHDLISX2LJZ7BMPBC3RQ236IMFRWIPB5Y6754GZ2CGMTHQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.623358601 (248h9m53.21746985s) [noise=true , address=145.79.227.44:4220 , piece_id=ERXYJ7RDNGIAKB5FDGQZKNOVS4BBH6RPMGBATJT2SN7RNNPJZBFA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.623798735 (248h9m53.21790998s) [noise=true , address=145.79.227.38:4996 , piece_id=H5AFPVFCAVTQFKXNEHEQZK3HSLTDT2YH2T64QH52EXAOR63U73TA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.626258015 (248h9m53.220369267s) [noise=true , address=193.149.164.66:4964 , piece_id=GQ6M3GURDBZCJKXAU5NVJEVMQUW76VL4P76BCLHQCKWQFKQ2NVXA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.626985646 (248h9m53.221096877s) [noise=true , address=167.17.72.70:4768 , piece_id=IXDJIX6MOBXXIPSNAFVKL4JY773H5VPLE3EH7JJPHFLH25B5TJNA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.627001442 (248h9m53.221112694s) [noise=true , address=145.79.227.43:4188 , piece_id=VR4H4JMVUXVQZDYTTTE25ACFOYOQDN2WAZG73EXO3HXXNI5ONV6A, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.627116746 (248h9m53.221227997s) [noise=true , address=77.90.31.17:4776 , piece_id=VPIE54OHBAK6BPD2YFQLMOM3TAVV3D2AM7QDMYU3RDUBUGR35QZA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.627175745 (248h9m53.221286997s) [noise=true , address=167.17.72.68:4665 , piece_id=V7MVQNTJBR47ZXV5OQDKFAZZSD6SWRDOBRQXP3FLO4EOYLTLRDGA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.627717332 (248h9m53.22182858s) [noise=true , address=145.79.227.34:4911 , piece_id=OSB72XALOCQQNPRTSGRVJEURNSGC7BJDCOQO5ESUG3KUEHBYHQPQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.628414931 (248h9m53.222526181s) [noise=true , address=193.149.164.143:4703 , piece_id=M5JEHJTIB6O26LSGOJ35YJMCAC3FBYPEMFUDTLUIDPV4DQ3DGZIA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.628949954 (248h9m53.223061201s) [noise=true , address=193.149.164.71:4309 , piece_id=Z3YVOYXBSUSPGE2QEZG564X66XDIKBLWYK25QMTJX6DJHFBBF4HA, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.629494297 (248h9m53.223605549s) [noise=true , address=145.79.227.49:4368 , piece_id=4DT2YSUNACKI2WU2XOXRMZTIRDVEN6MQFJKFRR3ZQZYKDJKSOUVQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.630043468 (248h9m53.224154719s) [noise=true , address=167.17.72.71:4791 , piece_id=MX3DLVKGP2JJJ4YIXFMAJQU4JTRF4G3SYAHNCDVZKL56DY54QORQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:42.630114279 (248h9m53.22422552s) [noise=true , address=145.79.227.41:4118 , piece_id=TNG4MKPDSXFULBUQ7AYXHTP4JFVOCGGX7HSJ2LXUVAGH42TVKHEQ, seg_pos={0 0}, upload=238593]: Uploading piece... Apr 18 00:26:43.206024764 (248h9m53.800136004s) [upload=238593]: Next returned nil segment Apr 18 00:26:43.206040938 (248h9m53.800152182s) [upload=238593]: Waiting for error group managing segments... Apr 18 00:26:43.789042391 (248h9m54.383153635s) [noise=true , address=45.91.116.11:4130 , piece_id=PKKVDNCSXMXR7OKLRSTROQEPX36KGUL7KERP6WHK225UHJF62UQQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:43.844139364 (248h9m54.438250618s) [noise=true , address=145.79.227.41:4118 , piece_id=TNG4MKPDSXFULBUQ7AYXHTP4JFVOCGGX7HSJ2LXUVAGH42TVKHEQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:46.701332878 (248h9m57.295444129s) [noise=true , address=193.149.164.66:4964 , piece_id=GQ6M3GURDBZCJKXAU5NVJEVMQUW76VL4P76BCLHQCKWQFKQ2NVXA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:48.052137224 (248h9m58.646248468s) [noise=true , address=145.79.227.34:4911 , piece_id=OSB72XALOCQQNPRTSGRVJEURNSGC7BJDCOQO5ESUG3KUEHBYHQPQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:49.032724323 (248h9m59.626835564s) [noise=true , address=167.17.72.70:4768 , piece_id=IXDJIX6MOBXXIPSNAFVKL4JY773H5VPLE3EH7JJPHFLH25B5TJNA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:51.198878900 (248h10m1.792990132s) [noise=true , address=145.79.227.44:4220 , piece_id=ERXYJ7RDNGIAKB5FDGQZKNOVS4BBH6RPMGBATJT2SN7RNNPJZBFA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:52.246458802 (248h10m2.840570042s) [noise=true , address=77.90.31.17:4776 , piece_id=VPIE54OHBAK6BPD2YFQLMOM3TAVV3D2AM7QDMYU3RDUBUGR35QZA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:52.629234206 (248h10m3.223345469s) [noise=true , address=193.149.164.71:4309 , piece_id=Z3YVOYXBSUSPGE2QEZG564X66XDIKBLWYK25QMTJX6DJHFBBF4HA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:53.867336901 (248h10m4.461448141s) [noise=true , address=167.17.72.68:4665 , piece_id=V7MVQNTJBR47ZXV5OQDKFAZZSD6SWRDOBRQXP3FLO4EOYLTLRDGA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:53.893081981 (248h10m4.487193229s) [noise=true , address=145.79.227.43:4188 , piece_id=VR4H4JMVUXVQZDYTTTE25ACFOYOQDN2WAZG73EXO3HXXNI5ONV6A, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:26:54.308730435 (248h10m4.902841675s) [noise=true , address=145.79.227.13:4834 , piece_id=PK7KWU5BAGG2X56ICRTUET45DWTQ7IDLSUT2ROSKWBAEKTQHDNLA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:27:16.520823809 (248h10m27.114935049s) [noise=true , address=145.79.227.38:4996 , piece_id=H5AFPVFCAVTQFKXNEHEQZK3HSLTDT2YH2T64QH52EXAOR63U73TA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:27:30.889161327 (248h10m41.483272568s) [noise=true , address=145.79.227.29:4954 , piece_id=A5Q5BLUHDLISX2LJZ7BMPBC3RQ236IMFRWIPB5Y6754GZ2CGMTHQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: <nil> Apr 18 00:27:42.221011487 (248h10m52.815122736s) [noise=true , address=167.17.72.71:4791 , piece_id=MX3DLVKGP2JJJ4YIXFMAJQU4JTRF4G3SYAHNCDVZKL56DY54QORQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: ecclient: upload failed (node:1nJkNrQsUMSuCHPpZkW5ztce4Y6hTe2CbtAhBDqGtHn6mQrc1f, address:167.17.72.71:4791): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 00:27:42.221112883 (248h10m52.815224143s) [noise=true , address=145.79.227.49:4368 , piece_id=4DT2YSUNACKI2WU2XOXRMZTIRDVEN6MQFJKFRR3ZQZYKDJKSOUVQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: ecclient: upload failed (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB, address:145.79.227.49:4368): protocol: read tcp 139.59.144.22:42326->145.79.227.49:4368: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:27:42.221218118 (248h10m52.81532944s) [noise=true , address=145.79.227.33:4902 , piece_id=ZCBDDC7H7GVB4XDQ2DLMZT4YT3TKZGMGU4ZNBVVLFNHIPHWOI7DA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: ecclient: upload failed (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE, address:145.79.227.33:4902): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 00:27:42.221280162 (248h10m52.815391404s) [noise=true , address=145.79.227.11:4737 , piece_id=MRQDYOT6GILDAFSYWB7TSL7SFE47BLZG5PD3RSYOPMYAURGTCFHQ, seg_pos={0 0}, upload=238593]: Done uploading piece. err: ecclient: upload failed (node:12jSyKX7N1ngVoXmADe6qBrVVoc4CVjHYfhsHqENf4cUPmNTnAh, address:145.79.227.11:4737): protocol: rpc: dial tcp 145.79.227.11:4737: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:27:42.221447383 (248h10m52.815558632s) [noise=true , address=193.149.164.143:4703 , piece_id=M5JEHJTIB6O26LSGOJ35YJMCAC3FBYPEMFUDTLUIDPV4DQ3DGZIA, seg_pos={0 0}, upload=238593]: Done uploading piece. err: ecclient: upload failed (node:12eomwcuHK58QuxBp3sAARJjm6Doc7zEzRYCodsTzFT4v6Nti9g, address:193.149.164.143:4703): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 00:27:42.221521292 (248h10m52.815632545s) [seg_pos={0 0}, upload=238593]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 00:27:42.327888338 (248h10m52.921999578s) [upload=238593]: Done uploading segments... Apr 18 00:27:42.327949951 (248h10m52.922061198s) [upload=238593]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.109527394s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 15 out of 60 is failed (threshold=6) [.............X........................X.X.X.X...X.X.XXXXXXXX] duration: 5.00073702s trace: https://jaeger.dev.storj.io/trace/45fabfe03595fbb5 FAIL (2026-04-18 00:27:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000773669s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 14 out of 60 is failed (threshold=6) [..............X........................X.X.X.X...X.X.XXXXXXX] duration: 5.00139285s trace: https://jaeger.dev.storj.io/trace/69a564ed0d771d57 FAIL (2026-04-18 00:27:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001421943s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........X...X....................................X....X..] duration: 30.284474642s trace: https://jaeger.dev.storj.io/trace/53f0de1d9d23c4a2 FAIL (2026-04-18 00:26:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.284509121s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.004915227s trace: https://jaeger.dev.storj.io/trace/1d5a091af2492c17 FAIL (2026-04-18 00:26:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ZJGMQOQOC3TTJGZFGKIZYBA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.475796259 (248h8m53.069907509s) [noise=true , address=145.79.227.11:4743 , piece_id=K7PS4PTGK7ZHJI675OMTESMP4SFFP5U53JVQLZF6DMIKIU76S7HQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.476315523 (248h8m53.070426774s) [noise=true , address=193.149.164.71:4293 , piece_id=RBVMN2OU5X73CMVPZZOTB6SBXXR7CTS5275FZX3ZN63VVSFRNYGQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.477444923 (248h8m53.071556175s) [noise=true , address=145.79.227.15:4891 , piece_id=HQBTTIUSYQOCE5NU4JWH7WC3V754YUO6MIJOQBHTYGX2KOXZ6SDQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.477987128 (248h8m53.07209838s) [noise=true , address=145.79.227.34:4918 , piece_id=Q2DBMNPHXFIJL6IXJYVOH7KZNP2JCY7JSEXQV6GSFV7HMLNGBI6A, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.478345774 (248h8m53.072457023s) [noise=true , address=167.17.72.70:4772 , piece_id=XU47XTTO2DS5XDIR7CNGKI45XBMX64KKBBAIO75KG5MQCWVZPODA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.478915807 (248h8m53.073027061s) [noise=true , address=193.149.164.66:4961 , piece_id=G7RZ555O7XH6ITD57F5TYXGTH3CDQ5XDLPGZJ5ERKIVEBZZCK55Q, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.479432516 (248h8m53.073543783s) [noise=true , address=77.90.31.14:4691 , piece_id=UOFYRAB7PZXCN7WLTFD7KH3F2JRJMYM43P3CE3VBLT7POMGFS7KQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.482367192 (248h8m53.076478445s) [noise=true , address=167.17.72.69:4717 , piece_id=PSJNPQBYV3GUVOVTNIRRZKKEXYCQX4S5Y5DBNQMIPSVZ2KJYZQ2A, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.482957154 (248h8m53.0770684s) [noise=true , address=145.79.227.35:4503 , piece_id=A3KPY23Q5WORSDKYHTPZYEGFBVFWVM3Z2CJ2BVK4NZ7HMDLVNEAA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.483605570 (248h8m53.077716878s) [noise=true , address=145.79.227.44:4226 , piece_id=2NMQKB22YC6HUT7IGYFPIGQA2WLNWBYP4C7JTS2CE7XVHQMJUJRA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.484508980 (248h8m53.07862022s) [noise=true , address=77.90.31.17:4776 , piece_id=3USQBIICKBMYP735TI22DYMD76LI5TQH6Z5IJAHE74BCBYZXCPGQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.485073792 (248h8m53.079185035s) [noise=true , address=167.17.72.71:4788 , piece_id=W3UCRZM3NWVFZG24IK5RPFMYWOORQSZEAF2JWQT2T3Z6NJ5CEWWQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.485562578 (248h8m53.079673826s) [noise=true , address=167.17.72.68:4650 , piece_id=ATQPNONJWFV6PPQGGTVPMI6OR6PXYTGE3WLGLIHHJOMTRWCXJ7YA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.486118410 (248h8m53.080229657s) [noise=true , address=145.79.227.5:4249 , piece_id=JMWT4K2D4X7V6NXRPLXGPBTGJEZVSEY3HBFPOJHT74RMN2KEJOLQ, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.486611649 (248h8m53.0807229s) [noise=true , address=145.79.227.13:4823 , piece_id=EBMHCBOSYGHRYFS2XJ5R6FASXJ54EO6QU2JLV43TKKYDDQVJMPSA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:42.487103473 (248h8m53.081214725s) [noise=true , address=145.79.227.32:4845 , piece_id=4QIWVMNZEMYPWHE5TST7WJORXK24HIZWH3RD6UG7KG5QBLDX4MBA, seg_pos={0 0}, upload=238577]: Uploading piece... Apr 18 00:25:43.073426510 (248h8m53.667537761s) [upload=238577]: Next returned nil segment Apr 18 00:25:43.073445020 (248h8m53.66755627s) [upload=238577]: Waiting for error group managing segments... Apr 18 00:25:43.222208233 (248h8m53.816319475s) [noise=true , address=145.79.227.5:4249 , piece_id=JMWT4K2D4X7V6NXRPLXGPBTGJEZVSEY3HBFPOJHT74RMN2KEJOLQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:43.304607620 (248h8m53.898718862s) [noise=true , address=145.79.227.15:4891 , piece_id=HQBTTIUSYQOCE5NU4JWH7WC3V754YUO6MIJOQBHTYGX2KOXZ6SDQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:43.321351848 (248h8m53.915463089s) [noise=true , address=145.79.227.35:4503 , piece_id=A3KPY23Q5WORSDKYHTPZYEGFBVFWVM3Z2CJ2BVK4NZ7HMDLVNEAA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:43.479101780 (248h8m54.073213025s) [noise=true , address=77.90.31.14:4691 , piece_id=UOFYRAB7PZXCN7WLTFD7KH3F2JRJMYM43P3CE3VBLT7POMGFS7KQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: ecclient: upload failed (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ, address:77.90.31.14:4691): protocol: storage node overloaded, request limit: 2000 Apr 18 00:25:43.831151363 (248h8m54.425262612s) [noise=true , address=193.149.164.71:4293 , piece_id=RBVMN2OU5X73CMVPZZOTB6SBXXR7CTS5275FZX3ZN63VVSFRNYGQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:48.378601076 (248h8m58.972712305s) [noise=true , address=145.79.227.40:4074 , piece_id=7GJ62VFEUE3UY7TNRTHTJHGHAAEFMZJGMQOQOC3TTJGZFGKIZYBA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:49.076726589 (248h8m59.670837831s) [noise=true , address=145.79.227.34:4918 , piece_id=Q2DBMNPHXFIJL6IXJYVOH7KZNP2JCY7JSEXQV6GSFV7HMLNGBI6A, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:49.363887383 (248h8m59.957998865s) [noise=true , address=77.90.31.17:4776 , piece_id=3USQBIICKBMYP735TI22DYMD76LI5TQH6Z5IJAHE74BCBYZXCPGQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:52.109719081 (248h9m2.703830326s) [noise=true , address=145.79.227.32:4845 , piece_id=4QIWVMNZEMYPWHE5TST7WJORXK24HIZWH3RD6UG7KG5QBLDX4MBA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:54.953335198 (248h9m5.547446447s) [noise=true , address=167.17.72.69:4717 , piece_id=PSJNPQBYV3GUVOVTNIRRZKKEXYCQX4S5Y5DBNQMIPSVZ2KJYZQ2A, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:55.216740445 (248h9m5.8108517s) [noise=true , address=167.17.72.71:4788 , piece_id=W3UCRZM3NWVFZG24IK5RPFMYWOORQSZEAF2JWQT2T3Z6NJ5CEWWQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:55.764858992 (248h9m6.358970232s) [noise=true , address=167.17.72.68:4650 , piece_id=ATQPNONJWFV6PPQGGTVPMI6OR6PXYTGE3WLGLIHHJOMTRWCXJ7YA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:58.375011142 (248h9m8.969122375s) [noise=true , address=193.149.164.143:4694 , piece_id=OAYRPJW4A474FEYLWTGLZOO7TC342TOP665ZVM6T4CBBDQKZWKYQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:25:58.620122944 (248h9m9.214234185s) [noise=true , address=167.17.72.70:4772 , piece_id=XU47XTTO2DS5XDIR7CNGKI45XBMX64KKBBAIO75KG5MQCWVZPODA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:26:28.705542430 (248h9m39.299653683s) [noise=true , address=145.79.227.44:4226 , piece_id=2NMQKB22YC6HUT7IGYFPIGQA2WLNWBYP4C7JTS2CE7XVHQMJUJRA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: <nil> Apr 18 00:26:28.705574800 (248h9m39.299686052s) [seg_pos={0 0}, upload=238577]: Satisfied cohort requirements after 14 pieces Apr 18 00:26:28.706091421 (248h9m39.300202674s) [noise=true , address=145.79.227.13:4823 , piece_id=EBMHCBOSYGHRYFS2XJ5R6FASXJ54EO6QU2JLV43TKKYDDQVJMPSA, seg_pos={0 0}, upload=238577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JWhB5QxbZsTD863tEfkEN1CUbKBMQvMJ9ZaiMAwKvxxXyDkEq): protocol: write tcp 139.59.144.22:44126->145.79.227.13:4823: use of closed network connection; write tcp 139.59.144.22:44126->145.79.227.13:4823: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44126->145.79.227.13:4823: use of closed network connection Apr 18 00:26:28.706107647 (248h9m39.300218897s) [noise=true , address=145.79.227.13:4823 , piece_id=EBMHCBOSYGHRYFS2XJ5R6FASXJ54EO6QU2JLV43TKKYDDQVJMPSA, seg_pos={0 0}, upload=238577]: Long tail cancellation due to optimal threshold Apr 18 00:26:28.706404600 (248h9m39.300515852s) [noise=true , address=193.149.164.66:4961 , piece_id=G7RZ555O7XH6ITD57F5TYXGTH3CDQ5XDLPGZJ5ERKIVEBZZCK55Q, seg_pos={0 0}, upload=238577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NoouB13AEgBXEFZfHdCbE62gmPUB2xecLuBDFeuwp49FTUWQX): protocol: read tcp 139.59.144.22:57634->193.149.164.66:4961: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:26:28.706422707 (248h9m39.30053396s) [noise=true , address=193.149.164.66:4961 , piece_id=G7RZ555O7XH6ITD57F5TYXGTH3CDQ5XDLPGZJ5ERKIVEBZZCK55Q, seg_pos={0 0}, upload=238577]: Long tail cancellation due to optimal threshold Apr 18 00:26:28.706464974 (248h9m39.300576229s) [noise=true , address=145.79.227.11:4743 , piece_id=K7PS4PTGK7ZHJI675OMTESMP4SFFP5U53JVQLZF6DMIKIU76S7HQ, seg_pos={0 0}, upload=238577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UMjJdYFqUjDcAEamv69RrmqtBPT2wiAk585jBsrv6yxFESjNy): protocol: rpc: dial tcp 145.79.227.11:4743: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 00:26:28.706479397 (248h9m39.300590648s) [noise=true , address=145.79.227.11:4743 , piece_id=K7PS4PTGK7ZHJI675OMTESMP4SFFP5U53JVQLZF6DMIKIU76S7HQ, seg_pos={0 0}, upload=238577]: Long tail cancellation due to optimal threshold Apr 18 00:26:28.706510484 (248h9m39.300621733s) [seg_pos={0 0}, upload=238577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 18 00:26:28.706655585 (248h9m39.300766835s) [upload=238577]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 18 00:26:28.706666386 (248h9m39.300777628s) [upload=238577]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 18 00:26:28.850146807 (248h9m39.444258061s) [upload=238577]: Done uploading segments... Apr 18 00:26:28.850190048 (248h9m39.444301293s) [upload=238577]: Upload finished. err: <nil> Duration: 1m0.00493941s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 13 out of 60 is failed (threshold=6) [...............X........................X.X.X.X...X.X.XXXXXX] duration: 5.000810439s trace: https://jaeger.dev.storj.io/trace/6072035a2b0c3209 FAIL (2026-04-18 00:26:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000834592s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 12 out of 60 is failed (threshold=6) [................X........................X.X.X.X...X.X.XXXXX] duration: 5.000778725s trace: https://jaeger.dev.storj.io/trace/2c672af65773e01a FAIL (2026-04-18 00:26:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000802991s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............X...X....................................X....X.] duration: 25.874960498s trace: https://jaeger.dev.storj.io/trace/53f0de1d9d23c4a2 FAIL (2026-04-18 00:25:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 25.874986966s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............X...X....................................X....X] duration: 1m0.000795834s trace: https://jaeger.dev.storj.io/trace/53f0de1d9d23c4a2 FAIL (2026-04-18 00:25:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000846668s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 11 out of 60 is failed (threshold=6) [.................X........................X.X.X.X...X.X.XXXX] duration: 5.006868659s trace: https://jaeger.dev.storj.io/trace/49777e3b4f17b606 FAIL (2026-04-18 00:25:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.006896904s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............X...X....................................X....] duration: 25.414463182s trace: https://jaeger.dev.storj.io/trace/b1bd604deae73a9 FAIL (2026-04-18 00:23:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 25.415121915s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [..................X........................X.X.X.X...X.X.XXX] duration: 5.000888922s trace: https://jaeger.dev.storj.io/trace/17a6f81111ca3f79 FAIL (2026-04-18 00:23:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000912455s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 9 out of 60 is failed (threshold=6) [...................X........................X.X.X.X...X.X.XX] duration: 5.00153753s trace: https://jaeger.dev.storj.io/trace/28ee6c260d3fcedd FAIL (2026-04-18 00:23:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001563259s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [....................X........................X.X.X.X...X.X.X] duration: 5.002658514s trace: https://jaeger.dev.storj.io/trace/3185ccbe741aac43 FAIL (2026-04-18 00:23:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002678546s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............X...X....................................X...] duration: 11.415350632s trace: https://jaeger.dev.storj.io/trace/b1bd604deae73a9 FAIL (2026-04-18 00:22:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.415383952s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [................X...X....................................X..] duration: 15.332572894s trace: https://jaeger.dev.storj.io/trace/b1bd604deae73a9 FAIL (2026-04-18 00:22:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.332907183s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [.....................X........................X.X.X.X...X.X.] duration: 2.881836208s trace: https://jaeger.dev.storj.io/trace/194afa37d542b84d FAIL (2026-04-18 00:21:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.881892814s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [......................X........................X.X.X.X...X.X] duration: 5.024870576s trace: https://jaeger.dev.storj.io/trace/194afa37d542b84d FAIL (2026-04-18 00:21:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.024897148s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.................X...X....................................X.] duration: 8.810098466s trace: https://jaeger.dev.storj.io/trace/b1bd604deae73a9 FAIL (2026-04-18 00:21:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.810158878s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................X...X....................................X] duration: 1m0.00092214s trace: https://jaeger.dev.storj.io/trace/b1bd604deae73a9 FAIL (2026-04-18 00:21:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000963232s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 6 out of 60 is failed (threshold=6) [.......................X........................X.X.X.X...X.] duration: 1.988202395s trace: https://jaeger.dev.storj.io/trace/301c6501217ae743 FAIL (2026-04-18 00:20:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.988264071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 6 out of 60 is failed (threshold=6) [........................X........................X.X.X.X...X] duration: 5.011254169s trace: https://jaeger.dev.storj.io/trace/301c6501217ae743 FAIL (2026-04-18 00:20:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.01129832s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.........................X........................X.X.X.X...] duration: 2.827264855s trace: https://jaeger.dev.storj.io/trace/5874e3eaea827b30 FAIL (2026-04-18 00:19:42 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.827289952s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................X...X....................................] duration: 5.197954431s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:19:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.198057117s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................X...X...................................] duration: 30.798835516s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:19:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.799086864s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [..........................X........................X.X.X.X..] duration: 3.902866687s trace: https://jaeger.dev.storj.io/trace/5874e3eaea827b30 FAIL (2026-04-18 00:18:45 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.902904985s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration: 3.485549445s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:18:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.485604205s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................X...X.................................] duration: 9.832593759s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:18:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.832623915s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [...........................X........................X.X.X.X.] duration: 4.469985534s trace: https://jaeger.dev.storj.io/trace/5874e3eaea827b30 FAIL (2026-04-18 00:17:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.470064137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...X................................] duration: 9.50120365s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:17:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.501229174s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................X...X...............................] duration: 9.186335921s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:17:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.186365815s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [............................X........................X.X.X.X] duration: 5.001813698s trace: https://jaeger.dev.storj.io/trace/5874e3eaea827b30 FAIL (2026-04-18 00:16:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001838388s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration: 8.145042897s trace: https://jaeger.dev.storj.io/trace/3f4fccd50420a338 FAIL (2026-04-18 00:16:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.145075801s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.............................X........................X.X.X.] duration: 4.166283689s trace: https://jaeger.dev.storj.io/trace/1b42c57d9a060359 FAIL (2026-04-18 00:16:28 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.166539626s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)