Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 3.145659943s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:43:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.145693217s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................X...........................] duration: 1.656008283s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:43:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.656029058s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 3.310355143s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:43:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.310378807s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................X..........................] duration: 1.708545563s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:42:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.708566627s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 3.241624263s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:42:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.241664297s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................X.........................] duration: 1.77757011s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:42:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.777609531s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 3.349827878s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:42:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.349863816s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.448875621s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:41:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 4.448963645s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................X........................] duration: 2.157187803s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:41:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.157218185s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 2.235724453s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:41:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.235752234s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 3.098770731s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:41:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.098797551s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 3.230500177s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:40:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.230529598s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 3.359591577s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:40:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.359621747s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 1.593609341s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:40:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.593913652s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 2.136913586s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:40:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.136947019s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.013716379s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:40:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 4.013812019s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 1.580297223s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:39:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.580331395s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.219716076s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:39:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.219749111s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 1.593554136s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:39:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.593624461s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.16397531s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:39:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 5.164056165s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 1.627927193s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:38:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.628182612s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.401756802s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:38:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 4.401867913s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 1.661464535s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:37:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.661517467s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 3.153190377s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:37:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.153236963s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 3.273936894s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:37:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.27396609s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 2.248041026s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:36:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.248144287s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 1.65154971s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:36:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.65158768s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 3.65788596s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:35:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.657917202s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 1.607639046s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:35:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.60766902s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.601549473s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:35:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 4.601583866s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 1.788184324s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:34:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.788219983s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 3.269585318s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:34:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.269619924s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................................X............] duration: 1.653895011s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:34:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.653963167s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 3.295112108s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:33:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.295146139s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 1.622222949s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:32:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.622253164s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.280100165s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:31:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.280236274s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 2.092814256s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:31:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.092843324s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 1.730964899s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:31:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.730999095s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 1.752983338s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:31:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.753089914s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.318425628s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:30:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.318524304s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.139316713s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:30:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.139343952s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 1.700609632s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:30:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.700645615s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 3.074043404s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:29:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.074076673s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 1.749193021s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:29:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.749243896s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 3.687201874s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:29:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.687238276s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 2.172327636s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:28:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.172361179s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.33740072s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:28:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.338687661s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 3.248593641s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:28:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.248627032s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 2.114912356s trace: https://jaeger.dev.storj.io/trace/15001b0778f77a8 FAIL (2026-04-03 15:27:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.115001571s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 3.180833727s trace: https://jaeger.dev.storj.io/trace/c036a4f2d71a778 FAIL (2026-04-03 15:27:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece... Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments... Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil> Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments... Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil> Duration: 3.180934085s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)