Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 54.129608161s trace: https://jaeger.dev.storj.io/trace/523e7a327f03d8ae FAIL (2026-02-09 04:33:44 UTC) orbiter warning: context deadline exceeded Duration: 54.12962723s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 18.942160459s trace: https://jaeger.dev.storj.io/trace/13242a1892920b3d FAIL (2026-02-09 04:33:40 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 18.942180721s core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 14.472858511s trace: https://jaeger.dev.storj.io/trace/5c4197e05f18dac6 FAIL (2026-02-09 04:33:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 14.472899374s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 9.737699067s trace: https://jaeger.dev.storj.io/trace/5fefe32474c7e65b FAIL (2026-02-09 04:33:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 9 04:32:28.649861204 (588h37m6.533815404s) [upload=518174]: Starting upload Feb 9 04:32:28.649992214 (588h37m6.533946405s) [upload=518174]: Done starting upload Feb 9 04:32:28.650196385 (588h37m6.534150584s) [upload=518174]: Uploading segments... Feb 9 04:32:28.650406612 (588h37m6.534360818s) [upload=518174]: Got next segment. Inline: false Feb 9 04:32:28.650497856 (588h37m6.534452058s) [upload=518174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 04:32:28.650505319 (588h37m6.534459523s) [upload=518174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 04:32:52.516808120 (588h37m30.400762309s) [upload=518174]: Next segment err: context deadline exceeded Feb 9 04:32:52.517307535 ( Duration: 9.737728077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 32.278250715s trace: https://jaeger.dev.storj.io/trace/64b71b21641cebaf FAIL (2026-02-09 04:33:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 9 04:32:36.690714026 (588h37m14.574668225s) [upload=518175]: Starting upload Feb 9 04:32:36.690813057 (588h37m14.57476725s) [upload=518175]: Done starting upload Feb 9 04:32:36.691040421 (588h37m14.574994621s) [upload=518175]: Uploading segments... Feb 9 04:32:36.691464898 (588h37m14.575419102s) [upload=518175]: Got next segment. Inline: false Feb 9 04:32:36.691517327 (588h37m14.575471528s) [upload=518175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 04:32:36.691523535 (588h37m14.575477738s) [upload=518175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 04:33:03.406823597 (588h37m41.290777808s) [upload=518175]: Next segment err: context deadline exceeded Feb 9 04:33:03.407207853 (588h37m41.291162053s) [upload=518175]: Done uploading segments... Feb 9 04:33:03.407267454 (588h37m41.291221655s) [upload=518175]: Upload finished. err: context deadline exceeded Duration: 32.278273685s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 3.042008336s trace: https://jaeger.dev.storj.io/trace/2c4205b1088399cd FAIL (2026-02-09 04:33:35 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.042035071s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 24.69918226s trace: https://jaeger.dev.storj.io/trace/1adee2f5b1ba8853 FAIL (2026-02-09 04:33:34 UTC) orbiter warning: context deadline exceeded Duration: 24.699213811s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 3.140074737s trace: https://jaeger.dev.storj.io/trace/2cdded65485973a8 FAIL (2026-02-09 04:33:33 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 3.140124127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 888.600631ms trace: https://jaeger.dev.storj.io/trace/7f54d71187c78a8d FAIL (2026-02-09 04:33:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 9 04:32:39.005879364 (588h37m16.889833564s) [upload=518176]: Starting upload Feb 9 04:32:39.005991042 (588h37m16.88994525s) [upload=518176]: Done starting upload Feb 9 04:32:39.006077471 (588h37m16.890031661s) [upload=518176]: Uploading segments... Feb 9 04:32:39.006125333 (588h37m16.890079535s) [upload=518176]: Got next segment. Inline: true Feb 9 04:32:39.006131370 (588h37m16.890085569s) [upload=518176]: Waiting for error group managing segments... Feb 9 04:32:39.006185950 (588h37m16.890140153s) [upload=518176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 04:32:39.006192143 (588h37m16.890146347s) [upload=518176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 9 04:32:39.006196293 (588h37m16.890150493s) [upload=518176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 9 04:33:32.813246928 (588h38m10.697201139s) [upload=518176]: Done uploading segments... Feb 9 04:33:32.813310690 (588h38m10.6972649s) [upload=518176]: Upload finished. err: metaclient: context deadline exceeded Duration:* 888.621656ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 917.046893ms trace: https://jaeger.dev.storj.io/trace/7331088c6d146e0f FAIL (2026-02-09 04:33:33 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 917.070483ms core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.620881621s trace: https://jaeger.dev.storj.io/trace/3d6e4017a9ed27c7 FAIL (2026-02-09 04:33:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== ing piece... Feb 9 04:32:15.279066208 (588h36m53.163020417s) [noise=true , address=81.171.14.70:4031 , piece_id=VRCSCEHO4M75ZESXWRXQ2PDYMSF3JKUMLMD7BPOUOLV3YTV45OQA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.279621953 (588h36m53.16357616s) [noise=true , address=89.149.201.147:4004 , piece_id=YMKF3RSNGAJS3TFDCXJXEI2IALJXDCWJ4HCU7HGHZK4OHOWHBNMA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.280184238 (588h36m53.164138446s) [noise=true , address=185.167.204.205:4005 , piece_id=BCB6KW2VJWCTFUCJAXG4GGHGVUUMMSCASDBK7N2M3P7XHMNLY4QQ, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.280753457 (588h36m53.164707676s) [noise=true , address=89.149.201.147:4002 , piece_id=2ZZ267PMMQQJW7NJ6TOS7FG3P4BMTV7NH7QYTDA66MZEKNXZ5C2Q, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.281280076 (588h36m53.165234287s) [noise=true , address=185.167.204.205:4014 , piece_id=NXDLQCYM46I3DJWIU2IXESS7CCDLNCWIQP5ONKJEDFRVIN5YQQIA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.281963126 (588h36m53.165917336s) [noise=true , address=81.171.14.70:4044 , piece_id=RFJ4PK263DO274VT5RSMIL3YJP764RHPYSDKWPTLKSNN2OVQBNXQ, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.282713054 (588h36m53.166667262s) [noise=true , address=89.149.201.147:4008 , piece_id=NDYUYFGZSU6N4NZG47VGRKZKUL5W3TLAQGSEH5SJZXLMFHTRW6CQ, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.283653972 (588h36m53.167608157s) [noise=true , address=81.171.14.70:4029 , piece_id=YPOWFBEIZNDQ47JX6JRI7UFDP6PGCD2KEJO7GLA3NCIL2ZPG2L6Q, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.286643524 (588h36m53.17059771s) [noise=true , address=185.167.204.205:4001 , piece_id=SA4CFNEUCYC2ZMQFXAV2U5VN54DMXTP7R3GCML3J5OE26DWPSAFA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:16.050269264 (588h36m53.934223456s) [upload=518173]: Next returned nil segment Feb 9 04:32:16.050284027 (588h36m53.934238225s) [upload=518173]: Waiting for error group managing segments... Feb 9 04:32:16.442086992 (588h36m54.326041192s) [noise=true , address=185.167.204.205:4005 , piece_id=BCB6KW2VJWCTFUCJAXG4GGHGVUUMMSCASDBK7N2M3P7XHMNLY4QQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:16.645683791 (588h36m54.529638003s) [noise=true , address=89.149.201.147:4004 , piece_id=YMKF3RSNGAJS3TFDCXJXEI2IALJXDCWJ4HCU7HGHZK4OHOWHBNMA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.458075314 (588h36m55.342029505s) [noise=true , address=89.149.201.147:4008 , piece_id=NDYUYFGZSU6N4NZG47VGRKZKUL5W3TLAQGSEH5SJZXLMFHTRW6CQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.690505661 (588h36m55.57445986s) [noise=true , address=81.171.14.70:4043 , piece_id=LF24QG3KMO4YMBT53F43XPQLUZQO2EA52W3I7HWJKHRKCOFYI6VQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.700376547 (588h36m55.584330745s) [noise=true , address=89.149.201.147:4003 , piece_id=6PRISGVRXZSBWJFIE3QVNFIFPIYNK7MCT6XIUGMIF4EMQ7S7ZDCQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.840472519 (588h36m55.72442673s) [noise=true , address=89.149.201.147:4024 , piece_id=ILFMESGEQVYRX5VKEJ2TNI4OBQRHHNVWEQHZDLPH35OT52E22OUA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:18.175968138 (588h36m56.059922336s) [noise=true , address=81.171.14.70:4047 , piece_id=HHVTG6T5HOMTN723XOGDSVTOM5WMQJNL35KFNRFW5MI75NC2X77A, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:18.676236919 (588h36m56.560191119s) [noise=true , address=89.149.201.147:4011 , piece_id=V4KQCY2HBDFN5T2CKHJPJDGZQV65MXQPHGHJ5ME2CGDRYJH5YOFA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:18.968476268 (588h36m56.852430466s) [noise=true , address=81.171.14.70:4044 , piece_id=RFJ4PK263DO274VT5RSMIL3YJP764RHPYSDKWPTLKSNN2OVQBNXQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.448215472 (588h36m57.332169672s) [noise=true , address=81.171.14.70:4042 , piece_id=XPABIL2ELQQ5P25QGOARK7FBMJYVG7UD772RNILIM5KCKCUM23OA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.448540617 (588h36m57.332494836s) [noise=true , address=81.171.14.70:4031 , piece_id=VRCSCEHO4M75ZESXWRXQ2PDYMSF3JKUMLMD7BPOUOLV3YTV45OQA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.904763534 (588h36m57.788717733s) [noise=true , address=81.171.14.70:4033 , piece_id=W6JVAOI3DKWVJQMNRP4H6HKDBNUBEKFVZDPBZ3XD7Q47HRNWUUOQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.926053576 (588h36m57.810007779s) [noise=true , address=89.149.201.147:4021 , piece_id=BDJ6USGYFETQ7Q2GBTDDSRT4ON4YAWF3JD5CS3U3XTK3UEPOUPUA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:20.830302546 (588h36m58.714256749s) [noise=true , address=81.171.14.70:4029 , piece_id=YPOWFBEIZNDQ47JX6JRI7UFDP6PGCD2KEJO7GLA3NCIL2ZPG2L6Q, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:21.226795603 (588h36m59.110749805s) [noise=true , address=81.171.14.70:4037 , piece_id=VEYPF4SE7U2MV2QFJDV2QSZKQDDZQ6KLMZYHK7KTIKUPIFWUEHAA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:22.734165134 (588h37m0.618119341s) [noise=true , address=81.171.14.70:4038 , piece_id=TB44THK46M3IRLRW4BC5NPNE373H7W474RM34TAYFJRXXJDN6VHA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:26.209566083 (588h37m4.093520273s) [noise=true , address=185.167.204.205:4001 , piece_id=SA4CFNEUCYC2ZMQFXAV2U5VN54DMXTP7R3GCML3J5OE26DWPSAFA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:29.019477314 (588h37m6.903431524s) [noise=true , address=89.149.201.147:4019 , piece_id=OGAPAJI3S3QYPB6ESGN3S35DXFXRREI3NBLPGARKUPQVUO5MCGTQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:31.194454926 (588h37m9.078409132s) [noise=true , address=89.149.201.147:4006 , piece_id=DOGTWMKFN5AJDBNYY3CRIU555EM7ZKUWX7GPWXRSGFEYHWLIH4SA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:32.049128965 (588h37m9.933083164s) [noise=true , address=185.167.204.206:4050 , piece_id=5OXPNPV6XVRVAEZSSVPRKUCEA6VEO6DACLALY42KIUZKHLKHFXGA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:33:14.802676072 (588h37m52.686630281s) [noise=true , address=185.167.204.205:4009 , piece_id=TIMBBEDNPAXMBIX5VTJ56JALP6O3FUDW34TOYNI5HXJFHNSONUNQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.802752738 (588h37m52.686706949s) [noise=true , address=89.149.201.147:4023 , piece_id=CDFLMAFGTGN2WT6RZQCAZNZGGIRMTPKYBUOZSI2DM22QOZB6ALEA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.802767968 (588h37m52.686722173s) [noise=true , address=89.149.201.147:4002 , piece_id=2ZZ267PMMQQJW7NJ6TOS7FG3P4BMTV7NH7QYTDA66MZEKNXZ5C2Q, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.802849489 (588h37m52.686803698s) [noise=true , address=89.149.201.147:4001 , piece_id=IGQ5REAY7ES5R6L26JZRZ373WAX6JJLXAANFUX44MF6JMW4CTUVQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.803102136 (588h37m52.68705634s) [noise=true , address=185.167.204.206:4043 , piece_id=NAXABPV5J2XN26FKX7HTEBRUSB3MQVY4KFB5TNHDUEG3KEQQD6WQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.803397095 (588h37m52.687351304s) [noise=true , address=185.167.204.205:4014 , piece_id=NXDLQCYM46I3DJWIU2IXESS7CCDLNCWIQP5ONKJEDFRVIN5YQQIA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.803541869 (588h37m52.687496061s) [noise=true , address=185.167.204.206:4045 , piece_id=SINN4LCC54DUP4RIZSBDZJTYLCGCIB6VXB4VMXIQY6E4LDGE52BQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1JPbi9CNAvezq91fdgjboVcgrdwwN48dFfLXzzgXtJ9B5eEoYq, address:185.167.204.206:4045): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.804150669 (588h37m52.688104875s) [noise=true , address=185.167.204.206:4066 , piece_id=O33UFUHT327AZJQUGKLGAVIWVJWY6K4HXOXWFCVM4WYCUVXQBDVA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: context deadline exceeded; context deadline exceeded Feb 9 04:33:14.804224419 (588h37m52.688178631s) [seg_pos={0 0}, upload=518173]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Feb 9 04:33:15.200439975 (588h37m53.084394179s) [upload=518173]: Done uploading segments... Feb 9 04:33:15.200606623 (588h37m53.084560823s) [upload=518173]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 7.620950225s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 555.513255ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/51a2927e3f2dfed2 FAIL (2026-02-09 04:33:33 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 555.541017ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001900004s trace: https://jaeger.dev.storj.io/trace/7f54d71187c78a8d FAIL (2026-02-09 04:33:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 9 04:32:39.005879364 (588h37m16.889833564s) [upload=518176]: Starting upload Feb 9 04:32:39.005991042 (588h37m16.88994525s) [upload=518176]: Done starting upload Feb 9 04:32:39.006077471 (588h37m16.890031661s) [upload=518176]: Uploading segments... Feb 9 04:32:39.006125333 (588h37m16.890079535s) [upload=518176]: Got next segment. Inline: true Feb 9 04:32:39.006131370 (588h37m16.890085569s) [upload=518176]: Waiting for error group managing segments... Feb 9 04:32:39.006185950 (588h37m16.890140153s) [upload=518176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 04:32:39.006192143 (588h37m16.890146347s) [upload=518176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 9 04:32:39.006196293 (588h37m16.890150493s) [upload=518176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 9 04:33:32.813246928 (588h38m10.697201139s) [upload=518176]: Done uploading segments... Feb 9 04:33:32.813310690 (588h38m10.6972649s) [upload=518176]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1m0.001924812s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.001939018s trace: https://jaeger.dev.storj.io/trace/7331088c6d146e0f FAIL (2026-02-09 04:33:32 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.001964126s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 15.723447642s trace: https://jaeger.dev.storj.io/trace/3c442ac4579954f0 FAIL (2026-02-09 04:33:32 UTC) orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded Duration: 15.723469656s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m33.339283131s remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/51a2927e3f2dfed2 FAIL (2026-02-09 04:33:32 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 1m33.339304359s core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.001502304s trace: https://jaeger.dev.storj.io/trace/13242a1892920b3d FAIL (2026-02-09 04:33:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.001526722s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........................................................XXX] duration: 5.000881865s trace: https://jaeger.dev.storj.io/trace/70221381e291348e FAIL (2026-02-09 04:33:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000907149s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.006169533s trace: https://jaeger.dev.storj.io/trace/3c442ac4579954f0 FAIL (2026-02-09 04:33:16 UTC) orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded Duration: 30.006193709s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.401210959s trace: https://jaeger.dev.storj.io/trace/3d6e4017a9ed27c7 FAIL (2026-02-09 04:33:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== ing piece... Feb 9 04:32:15.279066208 (588h36m53.163020417s) [noise=true , address=81.171.14.70:4031 , piece_id=VRCSCEHO4M75ZESXWRXQ2PDYMSF3JKUMLMD7BPOUOLV3YTV45OQA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.279621953 (588h36m53.16357616s) [noise=true , address=89.149.201.147:4004 , piece_id=YMKF3RSNGAJS3TFDCXJXEI2IALJXDCWJ4HCU7HGHZK4OHOWHBNMA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.280184238 (588h36m53.164138446s) [noise=true , address=185.167.204.205:4005 , piece_id=BCB6KW2VJWCTFUCJAXG4GGHGVUUMMSCASDBK7N2M3P7XHMNLY4QQ, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.280753457 (588h36m53.164707676s) [noise=true , address=89.149.201.147:4002 , piece_id=2ZZ267PMMQQJW7NJ6TOS7FG3P4BMTV7NH7QYTDA66MZEKNXZ5C2Q, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.281280076 (588h36m53.165234287s) [noise=true , address=185.167.204.205:4014 , piece_id=NXDLQCYM46I3DJWIU2IXESS7CCDLNCWIQP5ONKJEDFRVIN5YQQIA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.281963126 (588h36m53.165917336s) [noise=true , address=81.171.14.70:4044 , piece_id=RFJ4PK263DO274VT5RSMIL3YJP764RHPYSDKWPTLKSNN2OVQBNXQ, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.282713054 (588h36m53.166667262s) [noise=true , address=89.149.201.147:4008 , piece_id=NDYUYFGZSU6N4NZG47VGRKZKUL5W3TLAQGSEH5SJZXLMFHTRW6CQ, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.283653972 (588h36m53.167608157s) [noise=true , address=81.171.14.70:4029 , piece_id=YPOWFBEIZNDQ47JX6JRI7UFDP6PGCD2KEJO7GLA3NCIL2ZPG2L6Q, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:15.286643524 (588h36m53.17059771s) [noise=true , address=185.167.204.205:4001 , piece_id=SA4CFNEUCYC2ZMQFXAV2U5VN54DMXTP7R3GCML3J5OE26DWPSAFA, seg_pos={0 0}, upload=518173]: Uploading piece... Feb 9 04:32:16.050269264 (588h36m53.934223456s) [upload=518173]: Next returned nil segment Feb 9 04:32:16.050284027 (588h36m53.934238225s) [upload=518173]: Waiting for error group managing segments... Feb 9 04:32:16.442086992 (588h36m54.326041192s) [noise=true , address=185.167.204.205:4005 , piece_id=BCB6KW2VJWCTFUCJAXG4GGHGVUUMMSCASDBK7N2M3P7XHMNLY4QQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:16.645683791 (588h36m54.529638003s) [noise=true , address=89.149.201.147:4004 , piece_id=YMKF3RSNGAJS3TFDCXJXEI2IALJXDCWJ4HCU7HGHZK4OHOWHBNMA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.458075314 (588h36m55.342029505s) [noise=true , address=89.149.201.147:4008 , piece_id=NDYUYFGZSU6N4NZG47VGRKZKUL5W3TLAQGSEH5SJZXLMFHTRW6CQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.690505661 (588h36m55.57445986s) [noise=true , address=81.171.14.70:4043 , piece_id=LF24QG3KMO4YMBT53F43XPQLUZQO2EA52W3I7HWJKHRKCOFYI6VQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.700376547 (588h36m55.584330745s) [noise=true , address=89.149.201.147:4003 , piece_id=6PRISGVRXZSBWJFIE3QVNFIFPIYNK7MCT6XIUGMIF4EMQ7S7ZDCQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:17.840472519 (588h36m55.72442673s) [noise=true , address=89.149.201.147:4024 , piece_id=ILFMESGEQVYRX5VKEJ2TNI4OBQRHHNVWEQHZDLPH35OT52E22OUA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:18.175968138 (588h36m56.059922336s) [noise=true , address=81.171.14.70:4047 , piece_id=HHVTG6T5HOMTN723XOGDSVTOM5WMQJNL35KFNRFW5MI75NC2X77A, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:18.676236919 (588h36m56.560191119s) [noise=true , address=89.149.201.147:4011 , piece_id=V4KQCY2HBDFN5T2CKHJPJDGZQV65MXQPHGHJ5ME2CGDRYJH5YOFA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:18.968476268 (588h36m56.852430466s) [noise=true , address=81.171.14.70:4044 , piece_id=RFJ4PK263DO274VT5RSMIL3YJP764RHPYSDKWPTLKSNN2OVQBNXQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.448215472 (588h36m57.332169672s) [noise=true , address=81.171.14.70:4042 , piece_id=XPABIL2ELQQ5P25QGOARK7FBMJYVG7UD772RNILIM5KCKCUM23OA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.448540617 (588h36m57.332494836s) [noise=true , address=81.171.14.70:4031 , piece_id=VRCSCEHO4M75ZESXWRXQ2PDYMSF3JKUMLMD7BPOUOLV3YTV45OQA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.904763534 (588h36m57.788717733s) [noise=true , address=81.171.14.70:4033 , piece_id=W6JVAOI3DKWVJQMNRP4H6HKDBNUBEKFVZDPBZ3XD7Q47HRNWUUOQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:19.926053576 (588h36m57.810007779s) [noise=true , address=89.149.201.147:4021 , piece_id=BDJ6USGYFETQ7Q2GBTDDSRT4ON4YAWF3JD5CS3U3XTK3UEPOUPUA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:20.830302546 (588h36m58.714256749s) [noise=true , address=81.171.14.70:4029 , piece_id=YPOWFBEIZNDQ47JX6JRI7UFDP6PGCD2KEJO7GLA3NCIL2ZPG2L6Q, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:21.226795603 (588h36m59.110749805s) [noise=true , address=81.171.14.70:4037 , piece_id=VEYPF4SE7U2MV2QFJDV2QSZKQDDZQ6KLMZYHK7KTIKUPIFWUEHAA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:22.734165134 (588h37m0.618119341s) [noise=true , address=81.171.14.70:4038 , piece_id=TB44THK46M3IRLRW4BC5NPNE373H7W474RM34TAYFJRXXJDN6VHA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:26.209566083 (588h37m4.093520273s) [noise=true , address=185.167.204.205:4001 , piece_id=SA4CFNEUCYC2ZMQFXAV2U5VN54DMXTP7R3GCML3J5OE26DWPSAFA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:29.019477314 (588h37m6.903431524s) [noise=true , address=89.149.201.147:4019 , piece_id=OGAPAJI3S3QYPB6ESGN3S35DXFXRREI3NBLPGARKUPQVUO5MCGTQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:31.194454926 (588h37m9.078409132s) [noise=true , address=89.149.201.147:4006 , piece_id=DOGTWMKFN5AJDBNYY3CRIU555EM7ZKUWX7GPWXRSGFEYHWLIH4SA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:32:32.049128965 (588h37m9.933083164s) [noise=true , address=185.167.204.206:4050 , piece_id=5OXPNPV6XVRVAEZSSVPRKUCEA6VEO6DACLALY42KIUZKHLKHFXGA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: <nil> Feb 9 04:33:14.802676072 (588h37m52.686630281s) [noise=true , address=185.167.204.205:4009 , piece_id=TIMBBEDNPAXMBIX5VTJ56JALP6O3FUDW34TOYNI5HXJFHNSONUNQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.802752738 (588h37m52.686706949s) [noise=true , address=89.149.201.147:4023 , piece_id=CDFLMAFGTGN2WT6RZQCAZNZGGIRMTPKYBUOZSI2DM22QOZB6ALEA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.802767968 (588h37m52.686722173s) [noise=true , address=89.149.201.147:4002 , piece_id=2ZZ267PMMQQJW7NJ6TOS7FG3P4BMTV7NH7QYTDA66MZEKNXZ5C2Q, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.802849489 (588h37m52.686803698s) [noise=true , address=89.149.201.147:4001 , piece_id=IGQ5REAY7ES5R6L26JZRZ373WAX6JJLXAANFUX44MF6JMW4CTUVQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.803102136 (588h37m52.68705634s) [noise=true , address=185.167.204.206:4043 , piece_id=NAXABPV5J2XN26FKX7HTEBRUSB3MQVY4KFB5TNHDUEG3KEQQD6WQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.803397095 (588h37m52.687351304s) [noise=true , address=185.167.204.205:4014 , piece_id=NXDLQCYM46I3DJWIU2IXESS7CCDLNCWIQP5ONKJEDFRVIN5YQQIA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.803541869 (588h37m52.687496061s) [noise=true , address=185.167.204.206:4045 , piece_id=SINN4LCC54DUP4RIZSBDZJTYLCGCIB6VXB4VMXIQY6E4LDGE52BQ, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1JPbi9CNAvezq91fdgjboVcgrdwwN48dFfLXzzgXtJ9B5eEoYq, address:185.167.204.206:4045): protocol: expected piece hash; context deadline exceeded; EOF Feb 9 04:33:14.804150669 (588h37m52.688104875s) [noise=true , address=185.167.204.206:4066 , piece_id=O33UFUHT327AZJQUGKLGAVIWVJWY6K4HXOXWFCVM4WYCUVXQBDVA, seg_pos={0 0}, upload=518173]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: context deadline exceeded; context deadline exceeded Feb 9 04:33:14.804224419 (588h37m52.688178631s) [seg_pos={0 0}, upload=518173]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Feb 9 04:33:15.200439975 (588h37m53.084394179s) [upload=518173]: Done uploading segments... Feb 9 04:33:15.200606623 (588h37m53.084560823s) [upload=518173]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1m0.401239113s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001047392s trace: https://jaeger.dev.storj.io/trace/2c4205b1088399cd FAIL (2026-02-09 04:33:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.001075784s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.000963894s trace: https://jaeger.dev.storj.io/trace/5c4197e05f18dac6 FAIL (2026-02-09 04:33:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.000991871s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001299137s trace: https://jaeger.dev.storj.io/trace/64b71b21641cebaf FAIL (2026-02-09 04:33:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 9 04:32:36.690714026 (588h37m14.574668225s) [upload=518175]: Starting upload Feb 9 04:32:36.690813057 (588h37m14.57476725s) [upload=518175]: Done starting upload Feb 9 04:32:36.691040421 (588h37m14.574994621s) [upload=518175]: Uploading segments... Feb 9 04:32:36.691464898 (588h37m14.575419102s) [upload=518175]: Got next segment. Inline: false Feb 9 04:32:36.691517327 (588h37m14.575471528s) [upload=518175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 04:32:36.691523535 (588h37m14.575477738s) [upload=518175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 04:33:03.406823597 (588h37m41.290777808s) [upload=518175]: Next segment err: context deadline exceeded Feb 9 04:33:03.407207853 (588h37m41.291162053s) [upload=518175]: Done uploading segments... Feb 9 04:33:03.407267454 (588h37m41.291221655s) [upload=518175]: Upload finished. err: context deadline exceeded Duration: 1m0.001324029s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001436551s trace: https://jaeger.dev.storj.io/trace/2cdded65485973a8 FAIL (2026-02-09 04:33:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 30.001482098s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001843063s trace: https://jaeger.dev.storj.io/trace/5fefe32474c7e65b FAIL (2026-02-09 04:32:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 9 04:32:28.649861204 (588h37m6.533815404s) [upload=518174]: Starting upload Feb 9 04:32:28.649992214 (588h37m6.533946405s) [upload=518174]: Done starting upload Feb 9 04:32:28.650196385 (588h37m6.534150584s) [upload=518174]: Uploading segments... Feb 9 04:32:28.650406612 (588h37m6.534360818s) [upload=518174]: Got next segment. Inline: false Feb 9 04:32:28.650497856 (588h37m6.534452058s) [upload=518174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 04:32:28.650505319 (588h37m6.534459523s) [upload=518174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 04:32:52.516808120 (588h37m30.400762309s) [upload=518174]: Next segment err: context deadline exceeded Feb 9 04:32:52.517307535 ( Duration: 30.00188934s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00130454s target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/2b03593df22bf5a6 FAIL (2026-02-09 04:32:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 30.00132983s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................................XX] duration: 5.00132792s trace: https://jaeger.dev.storj.io/trace/35800d6b20bb1f69 FAIL (2026-02-09 04:32:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001355199s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.00146755s trace: https://jaeger.dev.storj.io/trace/523e7a327f03d8ae FAIL (2026-02-09 04:32:49 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001489079s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.057384212s trace: https://jaeger.dev.storj.io/trace/755527e8f30880ad FAIL (2026-02-09 04:32:38 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 30.057408562s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001248611s trace: https://jaeger.dev.storj.io/trace/1adee2f5b1ba8853 FAIL (2026-02-09 04:32:36 UTC) orbiter warning: context deadline exceeded Duration: 30.001271649s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001747375s trace: https://jaeger.dev.storj.io/trace/272bdfba54754771 FAIL (2026-02-09 04:32:26 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.001767206s core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002438035s trace: https://jaeger.dev.storj.io/trace/710417e606d7aacd FAIL (2026-02-09 04:32:24 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.002459176s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001225607s trace: https://jaeger.dev.storj.io/trace/35ef585a8d335e6d FAIL (2026-02-09 04:32:19 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.001248818s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001094567s trace: https://jaeger.dev.storj.io/trace/d5339bdf8a8250e FAIL (2026-02-09 04:32:01 UTC) orbiter warning: context deadline exceeded Duration: 5.001114747s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.349491391s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:38:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.349586248s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 1.650846519s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:38:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.650889216s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.724684209s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:38:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.72471022s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 1.704760986s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:38:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.704803395s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.749326562s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:38:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.749442304s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.341883131s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:37:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.341918488s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.XX.........................................................] duration: 1.573940291s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:37:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.573966603s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.27745898s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:37:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.277487089s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..XX........................................................] duration: 1.618369705s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:37:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.618416194s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.865953932s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:37:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.866033236s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.343347078s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:36:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.343371813s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.267628409s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:36:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.267658363s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...XX.......................................................] duration: 1.551252545s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:36:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.551274478s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.378840616s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:35:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.378867536s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.737028159s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:35:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.737054876s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....XX......................................................] duration: 1.748397937s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:35:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.748458475s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)