Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 36 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X............] duration: 2.208993555s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:18:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.20902595s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.XXX..X.XXXX....X..........X................................] duration: 2.987736971s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:17:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.987772194s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [X.XXX..X.XXXX....X..........X...............................] duration: 2.950598928s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:17:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.950633065s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 37 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X...........] duration: 1.797525515s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:17:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.79769544s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 44 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X.......] duration: 7.934795146s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:17:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.934845743s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 45 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X......] duration: 3.754162388s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:16:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.754211455s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.X.XXX..X.XXXX....X..........X..............................] duration: 7.123497695s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:16:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.123532843s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 38 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X..........] duration: 1.721736216s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:16:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.721763055s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 39 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X.........] duration: 1.807201519s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:16:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.807224926s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 46 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X.....] duration: 7.689010441s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:16:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.689037336s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 40 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X........] duration: 1.900509345s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:16:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.90059401s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..X.XXX..X.XXXX....X..........X.............................] duration: 3.014764215s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:15:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.014801507s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 41 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X.......] duration: 2.761668222s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:15:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.761716595s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 47 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X....] duration: 9.1835935s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:15:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 9.183615144s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 42 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X......] duration: 1.786866654s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:15:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.786896104s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [X..X.XXX..X.XXXX....X..........X............................] duration: 3.044648435s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:14:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.044674335s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 43 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X.....] duration: 1.811007724s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:14:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.811075028s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 48 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X...] duration: 6.206262008s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:14:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.206295612s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [XX..X.XXX..X.XXXX....X..........X...........................] duration: 3.092607571s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:14:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.092649225s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 49 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X..] duration: 4.647791642s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:13:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 4.647824083s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [.XX..X.XXX..X.XXXX....X..........X..........................] duration: 4.249648287s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:13:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.249671237s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 44 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X....] duration: 2.041291784s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:13:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.041414343s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [X.XX..X.XXX..X.XXXX....X..........X.........................] duration: 3.519247978s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:13:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.519285529s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 50 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X.] duration: 9.415994139s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:12:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 9.416017081s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [XX.XX..X.XXX..X.XXXX....X..........X........................] duration: 3.295464211s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:12:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.295521979s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....X] duration: 1m0.109931966s trace: https://jaeger.dev.storj.io/trace/37547cd6b582267 FAIL (2026-04-18 02:12:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 813475s) [upload=240249]: Uploading segments... Apr 18 02:11:34.033162278 (249h54m44.627273526s) [upload=240249]: Got next segment. Inline: false Apr 18 02:11:34.033206060 (249h54m44.627317306s) [upload=240249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:11:34.033211627 (249h54m44.627322874s) [upload=240249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:11:34.143887479 (249h54m44.737998735s) [seg_pos={0 0}, upload=240249]: Begin upload segment... Apr 18 02:11:34.143990724 (249h54m44.738101991s) [seg_pos={0 0}, upload=240249]: Done begin upload segment. Apr 18 02:11:34.144035065 (249h54m44.738146326s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.144173984 (249h54m44.738285242s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.145993407 (249h54m44.740104668s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.146632130 (249h54m44.740743388s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147131073 (249h54m44.741242331s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.147645331 (249h54m44.741756591s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148170600 (249h54m44.742281878s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.148718883 (249h54m44.74283014s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149236868 (249h54m44.743348126s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.149773629 (249h54m44.743884886s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.150662409 (249h54m44.744773666s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.151344081 (249h54m44.745455338s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.152027438 (249h54m44.746138695s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153002236 (249h54m44.747113497s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153235588 (249h54m44.747346846s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.153808451 (249h54m44.747919708s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154648585 (249h54m44.748759835s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.154855923 (249h54m44.748967184s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Uploading piece... Apr 18 02:11:34.243611395 (249h54m44.83772264s) [noise=true , address=145.79.227.29:4949 , piece_id=PVG6JK3OTM6CIXK4BLCHQPNL7YGXMNN5WCLPVKLMXDM4L7TSWSNA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12fLpEnaKeREB5itFjYy5yxy15a9GRT2w4p512qvB9wPTXZZwGo, address:145.79.227.29:4949): protocol: rpc: dial tcp 145.79.227.29:4949: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:11:34.331213671 (249h54m44.925324921s) [noise=true , address=193.149.164.143:4694 , piece_id=ZXLLZD73W4REKK4NWNWWS2CV2H6VCVB6OQDBWPEAPZUZSLUXXNGQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused; write tcp 139.59.144.22:46688->193.149.164.143:4694: write: connection refused Apr 18 02:11:34.727604270 (249h54m45.321715519s) [upload=240249]: Next returned nil segment Apr 18 02:11:34.727624301 (249h54m45.32173555s) [upload=240249]: Waiting for error group managing segments... Apr 18 02:11:35.177690531 (249h54m45.77180177s) [noise=true , address=145.79.227.13:4811 , piece_id=65B6PJJ2RVBDSHNUTMYBKND4JVDOTHHOBTZMSP2FPJIQWZB5E4TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.180928339 (249h54m45.775039587s) [noise=true , address=45.91.116.11:4130 , piece_id=JQIIGNELLXAFCFPQRIIWURAF7GCENBXN2IX47GDBDCK4663EJ7GA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.359877754 (249h54m45.953988998s) [noise=true , address=167.17.72.69:4721 , piece_id=OBTN55XI73GF7CQAB3EG65TJ7TPZRE7M4ZUHIYURFAF2UWQFQJDA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.465790685 (249h54m46.059901925s) [noise=true , address=193.149.164.71:4296 , piece_id=3G2U7UBT3LCXV7BGWOE62GCL445NB2WKXGNRXLEWVCQ3YVGACMEQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.490324561 (249h54m46.084435803s) [noise=true , address=79.127.205.237:4238 , piece_id=XEL22YVUN5DHKHAMQ225UDALPADXTR363ZLDO2LWA72GAX6OWF2A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.599141523 (249h54m46.193252786s) [noise=true , address=79.127.205.234:4187 , piece_id=4VPAWDXVGPUQJXCJHBDPRV34RC2FVBVX5V4X4POGBPB4C6FH44UA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.746879966 (249h54m46.340991214s) [noise=true , address=193.149.164.66:4978 , piece_id=PJ5HM5G3FQ3RQOSJPKHNQXZW37T75X3DG7JLXJSM57VL3EAVLCKA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:35.759854123 (249h54m46.353965364s) [noise=true , address=145.79.227.11:4754 , piece_id=LJ26RH47HLPNGWCTGUHWSU4IOXDBPOYCG5Z53HOJMIW62U7JWQ2Q, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.041654214 (249h54m46.63576546s) [noise=true , address=79.127.205.233:4167 , piece_id=UEIOYADM64MO3CDDJ33HCISPVI6T47MZ5ONQHWHZUASQBITAHGKQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:36.562040461 (249h54m47.156151701s) [noise=true , address=45.91.116.4:4958 , piece_id=DGB5YIEIREDVEGNM4QZCJOULZ3UQKG6Q2EFOABSKB57HWJBET3TA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:37.006473786 (249h54m47.600585032s) [noise=true , address=77.90.31.17:4781 , piece_id=OOITU5Y73A47VRCDTC7ZTOECAJEI4X47SC7EUXKXRORHJZCOGXXQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:39.560159622 (249h54m50.154270868s) [noise=true , address=167.17.72.71:4798 , piece_id=22HYZVLPXVNAU3PXP7WHCTPIH66AOATUREEYDE67DK74Q7WTPWJA, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:11:40.303280817 (249h54m50.897392063s) [noise=true , address=145.79.227.46:4617 , piece_id=ANMMX6TESJXPONLEV7OS4T2XKS7JKUCL7MW2MZFFJBSILOIETZ6A, seg_pos={0 0}, upload=240249]: Done uploading piece. err: <nil> Apr 18 02:12:33.745029575 (249h55m44.339140825s) [noise=true , address=167.17.72.70:4778 , piece_id=M45E56OYHY6BAXOP37UN2DAVJKDTRICUXRVNQYBMGAMAZVP6EMYQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1DWfr9QGBeHeMGUazw9QEvSKJA2Y6q5W8hXLfV8zFCvDTScgwp, address:167.17.72.70:4778): protocol: write tcp 139.59.144.22:33706->167.17.72.70:4778: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:12:33.745286262 (249h55m44.339397518s) [noise=true , address=145.79.227.49:4357 , piece_id=WMGQ345LHFZNMTKP5VF22ELQFUSLAUWUXYQ5276VJB4OTDUUPTOQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi, address:145.79.227.49:4357): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:12:33.745517223 (249h55m44.339628472s) [noise=true , address=64.49.13.169:4706 , piece_id=OEOHJSD3QMU5QLBL6P6HY42IIZJLZEXAHYB5KRGRM5KLE7HX45NQ, seg_pos={0 0}, upload=240249]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:12:33.745586366 (249h55m44.339697597s) [seg_pos={0 0}, upload=240249]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:12:33.851761285 (249h55m44.445872539s) [upload=240249]: Done uploading segments... Apr 18 02:12:33.851916468 (249h55m44.446027742s) [upload=240249]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.10996028s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 45 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X...] duration: 3.438508384s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:12:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.438537666s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [.XX.XX..X.XXX..X.XXXX....X..........X.......................] duration: 3.854440646s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:12:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.85447623s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 46 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X..] duration: 2.649859028s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:11:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.649980252s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 16 out of 60 is failed (threshold=3) [X.XX.XX..X.XXX..X.XXXX....X..........X......................] duration: 3.732767953s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:11:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.732800292s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.....] duration: 10.405369262s trace: https://jaeger.dev.storj.io/trace/2967fd859cac0203 FAIL (2026-04-18 02:11:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 11.774780176s) [upload=240175]: Starting upload Apr 18 02:07:01.180757085 (249h50m11.774868329s) [upload=240175]: Done starting upload Apr 18 02:07:01.180985360 (249h50m11.77509659s) [upload=240175]: Uploading segments... Apr 18 02:07:01.181168233 (249h50m11.775279482s) [upload=240175]: Got next segment. Inline: false Apr 18 02:07:01.181243742 (249h50m11.775354995s) [upload=240175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:07:01.181252211 (249h50m11.775363439s) [upload=240175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:07:01.292933411 (249h50m11.887044657s) [seg_pos={0 0}, upload=240175]: Begin upload segment... Apr 18 02:07:01.293025664 (249h50m11.887136909s) [seg_pos={0 0}, upload=240175]: Done begin upload segment. Apr 18 02:07:01.293539607 (249h50m11.887650856s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.294842538 (249h50m11.88895379s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295300817 (249h50m11.889412067s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295682089 (249h50m11.889793333s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296033265 (249h50m11.89014451s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296397353 (249h50m11.890508604s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296744242 (249h50m11.89085549s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297070106 (249h50m11.891181352s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297406170 (249h50m11.891517417s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297754626 (249h50m11.891865876s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298147982 (249h50m11.892259228s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298480553 (249h50m11.892591799s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298842238 (249h50m11.89295348s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299206905 (249h50m11.893318155s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299556039 (249h50m11.893667284s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299897686 (249h50m11.894008933s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.300248777 (249h50m11.894360028s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.305139115 (249h50m11.899250367s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.500436842 (249h50m12.094548092s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:34372->193.149.164.143:4696: write: connection refused; conn closed: op Apr 18 02:07:01.894721177 (249h50m12.48883242s) [upload=240175]: Next returned nil segment Apr 18 02:07:01.894741405 (249h50m12.488852661s) [upload=240175]: Waiting for error group managing segments... Apr 18 02:07:02.076974039 (249h50m12.671085286s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.130318046 (249h50m12.724429299s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.700143270 (249h50m13.294254517s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.722235551 (249h50m13.31634681s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.729965985 (249h50m13.324077232s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.736816364 (249h50m13.330927615s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:03.217725826 (249h50m13.811837072s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.198688757 (249h50m14.792800008s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.636978042 (249h50m15.231089404s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.138727885 (249h50m16.732839133s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.553545637 (249h50m17.14765689s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:08.764696305 (249h50m19.358807547s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:09.639375880 (249h50m20.233487126s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:08:00.890680867 (249h51m11.484792122s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:08:00.890776321 (249h51m11.484887562s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: rpc: dial tcp 145.79.227.11:4760: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:08:00.891645963 (249h51m11.485757216s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892272363 (249h51m11.48638361s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:12UafxBVo9nuRVBcQmGE4gBP2pnXQ5YUrwHZdwPCeSBSBWCZKpQ, address:145.79.227.44:4205): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892471604 (249h51m11.486582847s) [seg_pos={0 0}, upload=240175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:08:00.998296578 (249h51m11.592407811s) [upload=240175]: Done uploading segments... Apr 18 02:08:00.998337329 (249h51m11.592448569s) [upload=240175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 10.405403002s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 47 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X.] duration: 3.19411244s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:10:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.194142398s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..X] duration: 5.001907623s trace: https://jaeger.dev.storj.io/trace/15bcaf84944be57a FAIL (2026-04-18 02:10:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001932514s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 16 out of 60 is failed (threshold=3) [.X.XX.XX..X.XXX..X.XXXX....X..........X.....................] duration: 3.224852373s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:10:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.224879478s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 52 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX....] duration: 13.041225607s trace: https://jaeger.dev.storj.io/trace/2967fd859cac0203 FAIL (2026-04-18 02:10:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 11.774780176s) [upload=240175]: Starting upload Apr 18 02:07:01.180757085 (249h50m11.774868329s) [upload=240175]: Done starting upload Apr 18 02:07:01.180985360 (249h50m11.77509659s) [upload=240175]: Uploading segments... Apr 18 02:07:01.181168233 (249h50m11.775279482s) [upload=240175]: Got next segment. Inline: false Apr 18 02:07:01.181243742 (249h50m11.775354995s) [upload=240175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:07:01.181252211 (249h50m11.775363439s) [upload=240175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:07:01.292933411 (249h50m11.887044657s) [seg_pos={0 0}, upload=240175]: Begin upload segment... Apr 18 02:07:01.293025664 (249h50m11.887136909s) [seg_pos={0 0}, upload=240175]: Done begin upload segment. Apr 18 02:07:01.293539607 (249h50m11.887650856s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.294842538 (249h50m11.88895379s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295300817 (249h50m11.889412067s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295682089 (249h50m11.889793333s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296033265 (249h50m11.89014451s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296397353 (249h50m11.890508604s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296744242 (249h50m11.89085549s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297070106 (249h50m11.891181352s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297406170 (249h50m11.891517417s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297754626 (249h50m11.891865876s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298147982 (249h50m11.892259228s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298480553 (249h50m11.892591799s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298842238 (249h50m11.89295348s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299206905 (249h50m11.893318155s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299556039 (249h50m11.893667284s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299897686 (249h50m11.894008933s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.300248777 (249h50m11.894360028s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.305139115 (249h50m11.899250367s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.500436842 (249h50m12.094548092s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:34372->193.149.164.143:4696: write: connection refused; conn closed: op Apr 18 02:07:01.894721177 (249h50m12.48883242s) [upload=240175]: Next returned nil segment Apr 18 02:07:01.894741405 (249h50m12.488852661s) [upload=240175]: Waiting for error group managing segments... Apr 18 02:07:02.076974039 (249h50m12.671085286s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.130318046 (249h50m12.724429299s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.700143270 (249h50m13.294254517s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.722235551 (249h50m13.31634681s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.729965985 (249h50m13.324077232s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.736816364 (249h50m13.330927615s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:03.217725826 (249h50m13.811837072s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.198688757 (249h50m14.792800008s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.636978042 (249h50m15.231089404s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.138727885 (249h50m16.732839133s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.553545637 (249h50m17.14765689s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:08.764696305 (249h50m19.358807547s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:09.639375880 (249h50m20.233487126s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:08:00.890680867 (249h51m11.484792122s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:08:00.890776321 (249h51m11.484887562s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: rpc: dial tcp 145.79.227.11:4760: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:08:00.891645963 (249h51m11.485757216s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892272363 (249h51m11.48638361s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:12UafxBVo9nuRVBcQmGE4gBP2pnXQ5YUrwHZdwPCeSBSBWCZKpQ, address:145.79.227.44:4205): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892471604 (249h51m11.486582847s) [seg_pos={0 0}, upload=240175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:08:00.998296578 (249h51m11.592407811s) [upload=240175]: Done uploading segments... Apr 18 02:08:00.998337329 (249h51m11.592448569s) [upload=240175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 13.041255275s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 53 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX...] duration: 22.423251263s trace: https://jaeger.dev.storj.io/trace/2967fd859cac0203 FAIL (2026-04-18 02:09:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 11.774780176s) [upload=240175]: Starting upload Apr 18 02:07:01.180757085 (249h50m11.774868329s) [upload=240175]: Done starting upload Apr 18 02:07:01.180985360 (249h50m11.77509659s) [upload=240175]: Uploading segments... Apr 18 02:07:01.181168233 (249h50m11.775279482s) [upload=240175]: Got next segment. Inline: false Apr 18 02:07:01.181243742 (249h50m11.775354995s) [upload=240175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:07:01.181252211 (249h50m11.775363439s) [upload=240175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:07:01.292933411 (249h50m11.887044657s) [seg_pos={0 0}, upload=240175]: Begin upload segment... Apr 18 02:07:01.293025664 (249h50m11.887136909s) [seg_pos={0 0}, upload=240175]: Done begin upload segment. Apr 18 02:07:01.293539607 (249h50m11.887650856s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.294842538 (249h50m11.88895379s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295300817 (249h50m11.889412067s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295682089 (249h50m11.889793333s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296033265 (249h50m11.89014451s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296397353 (249h50m11.890508604s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296744242 (249h50m11.89085549s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297070106 (249h50m11.891181352s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297406170 (249h50m11.891517417s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297754626 (249h50m11.891865876s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298147982 (249h50m11.892259228s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298480553 (249h50m11.892591799s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298842238 (249h50m11.89295348s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299206905 (249h50m11.893318155s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299556039 (249h50m11.893667284s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299897686 (249h50m11.894008933s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.300248777 (249h50m11.894360028s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.305139115 (249h50m11.899250367s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.500436842 (249h50m12.094548092s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:34372->193.149.164.143:4696: write: connection refused; conn closed: op Apr 18 02:07:01.894721177 (249h50m12.48883242s) [upload=240175]: Next returned nil segment Apr 18 02:07:01.894741405 (249h50m12.488852661s) [upload=240175]: Waiting for error group managing segments... Apr 18 02:07:02.076974039 (249h50m12.671085286s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.130318046 (249h50m12.724429299s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.700143270 (249h50m13.294254517s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.722235551 (249h50m13.31634681s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.729965985 (249h50m13.324077232s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.736816364 (249h50m13.330927615s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:03.217725826 (249h50m13.811837072s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.198688757 (249h50m14.792800008s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.636978042 (249h50m15.231089404s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.138727885 (249h50m16.732839133s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.553545637 (249h50m17.14765689s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:08.764696305 (249h50m19.358807547s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:09.639375880 (249h50m20.233487126s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:08:00.890680867 (249h51m11.484792122s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:08:00.890776321 (249h51m11.484887562s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: rpc: dial tcp 145.79.227.11:4760: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:08:00.891645963 (249h51m11.485757216s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892272363 (249h51m11.48638361s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:12UafxBVo9nuRVBcQmGE4gBP2pnXQ5YUrwHZdwPCeSBSBWCZKpQ, address:145.79.227.44:4205): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892471604 (249h51m11.486582847s) [seg_pos={0 0}, upload=240175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:08:00.998296578 (249h51m11.592407811s) [upload=240175]: Done uploading segments... Apr 18 02:08:00.998337329 (249h51m11.592448569s) [upload=240175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 22.42328144s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 16 out of 60 is failed (threshold=3) [..X.XX.XX..X.XXX..X.XXXX....X..........X....................] duration: 4.327935264s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:09:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.328030773s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX..] duration: 1.946935893s trace: https://jaeger.dev.storj.io/trace/1a3372b18135033a FAIL (2026-04-18 02:09:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.946965831s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 54 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX..] duration: 13.931458515s trace: https://jaeger.dev.storj.io/trace/2967fd859cac0203 FAIL (2026-04-18 02:08:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 11.774780176s) [upload=240175]: Starting upload Apr 18 02:07:01.180757085 (249h50m11.774868329s) [upload=240175]: Done starting upload Apr 18 02:07:01.180985360 (249h50m11.77509659s) [upload=240175]: Uploading segments... Apr 18 02:07:01.181168233 (249h50m11.775279482s) [upload=240175]: Got next segment. Inline: false Apr 18 02:07:01.181243742 (249h50m11.775354995s) [upload=240175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:07:01.181252211 (249h50m11.775363439s) [upload=240175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:07:01.292933411 (249h50m11.887044657s) [seg_pos={0 0}, upload=240175]: Begin upload segment... Apr 18 02:07:01.293025664 (249h50m11.887136909s) [seg_pos={0 0}, upload=240175]: Done begin upload segment. Apr 18 02:07:01.293539607 (249h50m11.887650856s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.294842538 (249h50m11.88895379s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295300817 (249h50m11.889412067s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295682089 (249h50m11.889793333s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296033265 (249h50m11.89014451s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296397353 (249h50m11.890508604s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296744242 (249h50m11.89085549s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297070106 (249h50m11.891181352s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297406170 (249h50m11.891517417s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297754626 (249h50m11.891865876s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298147982 (249h50m11.892259228s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298480553 (249h50m11.892591799s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298842238 (249h50m11.89295348s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299206905 (249h50m11.893318155s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299556039 (249h50m11.893667284s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299897686 (249h50m11.894008933s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.300248777 (249h50m11.894360028s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.305139115 (249h50m11.899250367s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.500436842 (249h50m12.094548092s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:34372->193.149.164.143:4696: write: connection refused; conn closed: op Apr 18 02:07:01.894721177 (249h50m12.48883242s) [upload=240175]: Next returned nil segment Apr 18 02:07:01.894741405 (249h50m12.488852661s) [upload=240175]: Waiting for error group managing segments... Apr 18 02:07:02.076974039 (249h50m12.671085286s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.130318046 (249h50m12.724429299s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.700143270 (249h50m13.294254517s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.722235551 (249h50m13.31634681s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.729965985 (249h50m13.324077232s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.736816364 (249h50m13.330927615s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:03.217725826 (249h50m13.811837072s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.198688757 (249h50m14.792800008s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.636978042 (249h50m15.231089404s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.138727885 (249h50m16.732839133s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.553545637 (249h50m17.14765689s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:08.764696305 (249h50m19.358807547s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:09.639375880 (249h50m20.233487126s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:08:00.890680867 (249h51m11.484792122s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:08:00.890776321 (249h51m11.484887562s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: rpc: dial tcp 145.79.227.11:4760: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:08:00.891645963 (249h51m11.485757216s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892272363 (249h51m11.48638361s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:12UafxBVo9nuRVBcQmGE4gBP2pnXQ5YUrwHZdwPCeSBSBWCZKpQ, address:145.79.227.44:4205): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892471604 (249h51m11.486582847s) [seg_pos={0 0}, upload=240175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:08:00.998296578 (249h51m11.592407811s) [upload=240175]: Done uploading segments... Apr 18 02:08:00.998337329 (249h51m11.592448569s) [upload=240175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 13.931490912s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 17 out of 60 is failed (threshold=3) [X..X.XX.XX..X.XXX..X.XXXX....X..........X...................] duration: 8.111375254s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:08:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.111414887s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX.] duration: 1.845829497s trace: https://jaeger.dev.storj.io/trace/1a3372b18135033a FAIL (2026-04-18 02:08:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.845861865s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 55 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX.] duration: 9.83971826s trace: https://jaeger.dev.storj.io/trace/2967fd859cac0203 FAIL (2026-04-18 02:08:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 11.774780176s) [upload=240175]: Starting upload Apr 18 02:07:01.180757085 (249h50m11.774868329s) [upload=240175]: Done starting upload Apr 18 02:07:01.180985360 (249h50m11.77509659s) [upload=240175]: Uploading segments... Apr 18 02:07:01.181168233 (249h50m11.775279482s) [upload=240175]: Got next segment. Inline: false Apr 18 02:07:01.181243742 (249h50m11.775354995s) [upload=240175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:07:01.181252211 (249h50m11.775363439s) [upload=240175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:07:01.292933411 (249h50m11.887044657s) [seg_pos={0 0}, upload=240175]: Begin upload segment... Apr 18 02:07:01.293025664 (249h50m11.887136909s) [seg_pos={0 0}, upload=240175]: Done begin upload segment. Apr 18 02:07:01.293539607 (249h50m11.887650856s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.294842538 (249h50m11.88895379s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295300817 (249h50m11.889412067s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295682089 (249h50m11.889793333s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296033265 (249h50m11.89014451s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296397353 (249h50m11.890508604s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296744242 (249h50m11.89085549s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297070106 (249h50m11.891181352s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297406170 (249h50m11.891517417s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297754626 (249h50m11.891865876s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298147982 (249h50m11.892259228s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298480553 (249h50m11.892591799s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298842238 (249h50m11.89295348s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299206905 (249h50m11.893318155s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299556039 (249h50m11.893667284s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299897686 (249h50m11.894008933s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.300248777 (249h50m11.894360028s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.305139115 (249h50m11.899250367s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.500436842 (249h50m12.094548092s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:34372->193.149.164.143:4696: write: connection refused; conn closed: op Apr 18 02:07:01.894721177 (249h50m12.48883242s) [upload=240175]: Next returned nil segment Apr 18 02:07:01.894741405 (249h50m12.488852661s) [upload=240175]: Waiting for error group managing segments... Apr 18 02:07:02.076974039 (249h50m12.671085286s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.130318046 (249h50m12.724429299s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.700143270 (249h50m13.294254517s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.722235551 (249h50m13.31634681s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.729965985 (249h50m13.324077232s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.736816364 (249h50m13.330927615s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:03.217725826 (249h50m13.811837072s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.198688757 (249h50m14.792800008s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.636978042 (249h50m15.231089404s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.138727885 (249h50m16.732839133s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.553545637 (249h50m17.14765689s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:08.764696305 (249h50m19.358807547s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:09.639375880 (249h50m20.233487126s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:08:00.890680867 (249h51m11.484792122s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:08:00.890776321 (249h51m11.484887562s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: rpc: dial tcp 145.79.227.11:4760: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:08:00.891645963 (249h51m11.485757216s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892272363 (249h51m11.48638361s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:12UafxBVo9nuRVBcQmGE4gBP2pnXQ5YUrwHZdwPCeSBSBWCZKpQ, address:145.79.227.44:4205): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892471604 (249h51m11.486582847s) [seg_pos={0 0}, upload=240175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:08:00.998296578 (249h51m11.592407811s) [upload=240175]: Done uploading segments... Apr 18 02:08:00.998337329 (249h51m11.592448569s) [upload=240175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 9.83975028s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 56 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XXX] duration: 1m0.116189052s trace: https://jaeger.dev.storj.io/trace/2967fd859cac0203 FAIL (2026-04-18 02:08:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 11.774780176s) [upload=240175]: Starting upload Apr 18 02:07:01.180757085 (249h50m11.774868329s) [upload=240175]: Done starting upload Apr 18 02:07:01.180985360 (249h50m11.77509659s) [upload=240175]: Uploading segments... Apr 18 02:07:01.181168233 (249h50m11.775279482s) [upload=240175]: Got next segment. Inline: false Apr 18 02:07:01.181243742 (249h50m11.775354995s) [upload=240175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:07:01.181252211 (249h50m11.775363439s) [upload=240175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:07:01.292933411 (249h50m11.887044657s) [seg_pos={0 0}, upload=240175]: Begin upload segment... Apr 18 02:07:01.293025664 (249h50m11.887136909s) [seg_pos={0 0}, upload=240175]: Done begin upload segment. Apr 18 02:07:01.293539607 (249h50m11.887650856s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.294842538 (249h50m11.88895379s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295300817 (249h50m11.889412067s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.295682089 (249h50m11.889793333s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296033265 (249h50m11.89014451s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296397353 (249h50m11.890508604s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.296744242 (249h50m11.89085549s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297070106 (249h50m11.891181352s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297406170 (249h50m11.891517417s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.297754626 (249h50m11.891865876s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298147982 (249h50m11.892259228s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298480553 (249h50m11.892591799s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.298842238 (249h50m11.89295348s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299206905 (249h50m11.893318155s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299556039 (249h50m11.893667284s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.299897686 (249h50m11.894008933s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.300248777 (249h50m11.894360028s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.305139115 (249h50m11.899250367s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Uploading piece... Apr 18 02:07:01.500436842 (249h50m12.094548092s) [noise=true , address=193.149.164.143:4696 , piece_id=3DAAFESUBMPPN72P5TKVW75QG2AHSX4JV44MS3LTMTNP5YNPI7NQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:34372->193.149.164.143:4696: write: connection refused; conn closed: op Apr 18 02:07:01.894721177 (249h50m12.48883242s) [upload=240175]: Next returned nil segment Apr 18 02:07:01.894741405 (249h50m12.488852661s) [upload=240175]: Waiting for error group managing segments... Apr 18 02:07:02.076974039 (249h50m12.671085286s) [noise=true , address=145.79.227.52:4452 , piece_id=CYAYISM2LSUW64UEO2M45UQL3AVW25UKDZXR4JLPVK2GK7PNESRA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.130318046 (249h50m12.724429299s) [noise=true , address=145.79.227.13:4820 , piece_id=WIVQAKIED5IGK2HMDDYTA5BX5S4I7ZX6LBHLFTQ4R3BWF3AWZGBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.700143270 (249h50m13.294254517s) [noise=true , address=79.127.205.235:4259 , piece_id=6VSSTNZ5MZE73ZYKH24FP3S6NMGPUOJ2YU7UVOFMALW7EMERL43A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.722235551 (249h50m13.31634681s) [noise=true , address=79.127.205.233:4153 , piece_id=XNSML5WZWBUDKTDWEUDDE35JOHAIGTFWIXN5UPMLX72LX5OUZTBA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.729965985 (249h50m13.324077232s) [noise=true , address=79.127.205.234:4201 , piece_id=3OX5R6T5GSGFXE2FZSCDTGY4UD3DKJA6IEPX5F2WHT6IK7NJOE7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:02.736816364 (249h50m13.330927615s) [noise=true , address=167.17.72.71:4805 , piece_id=SP7LAF6GXX37RFT6U4M7IXLDAMUFISWUNHSKDJJ35O5ISMGDCDNA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:03.217725826 (249h50m13.811837072s) [noise=true , address=193.149.164.71:4288 , piece_id=64NDF72ZNNJAF3O3XBBLOIKP7CNSIFUAPKV54MWCKAUJ3RJPG2RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.198688757 (249h50m14.792800008s) [noise=true , address=167.17.72.70:4769 , piece_id=I53QO4KXRCYBX37QN3GO6ESWYQLLGRVJZGKYXNK37J2LVS5NWVGQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:04.636978042 (249h50m15.231089404s) [noise=true , address=167.17.72.68:4644 , piece_id=KDF4UKI57AAGYELLSKE4TCNJAAUALEWF2R2TAU6IULDG6RGBRXQQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.138727885 (249h50m16.732839133s) [noise=true , address=145.79.227.9:4399 , piece_id=XXOJ43XTJDKYIDBOEVOD44GR57LDHOP25EACTIS3RCWSAKZMZXYA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:06.553545637 (249h50m17.14765689s) [noise=true , address=77.90.31.11:4566 , piece_id=L36ZMC3ND56T6TSZFVHGS76KXIDJBLMEWWKUON3IKC2XXPIES4RQ, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:08.764696305 (249h50m19.358807547s) [noise=true , address=145.79.227.33:4879 , piece_id=DORIWIXSPB7SDRTZV52EJWJP2BI7MKWNX3O5NCY24EBTP6GBTTMA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:07:09.639375880 (249h50m20.233487126s) [noise=true , address=167.17.72.69:4724 , piece_id=FP4XSTMRCELITDAFYCVMSCCD22BD3D4XYJGR2Z4QBQRWSXJDTD7Q, seg_pos={0 0}, upload=240175]: Done uploading piece. err: <nil> Apr 18 02:08:00.890680867 (249h51m11.484792122s) [noise=true , address=145.79.227.21:4508 , piece_id=T2OCNTKI6OZCSNTKDXLNU2IBKOC4UAYCFFIWDYRSHPYGWLQUYFZA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1269NRnqpabU6H8q9vSCmE8yMzznD1L7dyZFmzCWhtzJaTjbXg3, address:145.79.227.21:4508): protocol: expected piece hash; context deadline exceeded; EOF Apr 18 02:08:00.890776321 (249h51m11.484887562s) [noise=true , address=145.79.227.11:4760 , piece_id=NQRE6BQXSFUTVEOZLT75O36UQPRBCBU5BDYHGHQDXXJQ5DYWTBEA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: rpc: dial tcp 145.79.227.11:4760: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:08:00.891645963 (249h51m11.485757216s) [noise=true , address=145.79.227.38:4984 , piece_id=R5VAPPKIIPR7NIMTYOEHV6HNSZDWXSZRIJMF6DKLWMPKTSYQVI5A, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892272363 (249h51m11.48638361s) [noise=true , address=145.79.227.44:4205 , piece_id=M45SSYPWZRO6G67SFEDNSTYIOZC247SP7EUNQQYVA2TKA6DYWYJA, seg_pos={0 0}, upload=240175]: Done uploading piece. err: ecclient: upload failed (node:12UafxBVo9nuRVBcQmGE4gBP2pnXQ5YUrwHZdwPCeSBSBWCZKpQ, address:145.79.227.44:4205): protocol: context deadline exceeded; context deadline exceeded Apr 18 02:08:00.892471604 (249h51m11.486582847s) [seg_pos={0 0}, upload=240175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:08:00.998296578 (249h51m11.592407811s) [upload=240175]: Done uploading segments... Apr 18 02:08:00.998337329 (249h51m11.592448569s) [upload=240175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.116206706s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....XX] duration: 5.00356745s trace: https://jaeger.dev.storj.io/trace/1a3372b18135033a FAIL (2026-04-18 02:07:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00359469s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 17 out of 60 is failed (threshold=3) [.X..X.XX.XX..X.XXX..X.XXXX....X..........X..................] duration: 6.724225239s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:07:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.724321866s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 56 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.XX] duration: 1m0.149327824s trace: https://jaeger.dev.storj.io/trace/42b13bda40357af0 FAIL (2026-04-18 02:07:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 06:00.875222314 (249h49m11.469333559s) [upload=240158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:06:00.875228700 (249h49m11.469339944s) [upload=240158]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:06:00.984272835 (249h49m11.578384089s) [seg_pos={0 0}, upload=240158]: Begin upload segment... Apr 18 02:06:00.984490151 (249h49m11.578601404s) [seg_pos={0 0}, upload=240158]: Done begin upload segment. Apr 18 02:06:00.984585703 (249h49m11.578696956s) [noise=true , address=145.79.227.49:4349 , piece_id=WJPYL3ALQIJ2RLZWICA4VAKVNHTEVDXYE2Q6MDDHZFUFPZMT654A, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.984915334 (249h49m11.579026592s) [noise=true , address=145.79.227.38:4987 , piece_id=CPACAC467P5XMJT62FBQPKYOSGE6GPH4EKMG2DZI2VSBGMLBBCVA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.985844999 (249h49m11.579956251s) [noise=true , address=145.79.227.11:4758 , piece_id=D7R5TAQRYAWUHMCA7KKHCGSKISGUYWSYRVRC3ANQJAMYJTOU54KA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.985867482 (249h49m11.579978734s) [noise=true , address=145.79.227.40:4081 , piece_id=NZDYG4EVFEVJMGHLKCARM7RCXPPXGVVINRLL2DRENVXW5Y4BQV2Q, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.986452119 (249h49m11.580563368s) [noise=true , address=167.17.72.69:4743 , piece_id=Z7LC2AVAQI7EXXAVWTQ2POBB6YE4GUE3XV3RVYWXDC36RAHO3EXA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.986625099 (249h49m11.580736352s) [noise=true , address=167.17.72.71:4794 , piece_id=NMP5XGESL4DN5YKP4KN5TCA3RUBIYX6SR632ABEMSD6V4JZRRIJA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.986951371 (249h49m11.581062744s) [noise=true , address=5.231.73.4:4023 , piece_id=EJZRXYMX3UIO7JXZIDXO5I54GYSNIVEEMJCFEU3OZB6BP4IEGXTQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.987214579 (249h49m11.581325833s) [noise=true , address=79.127.205.233:4157 , piece_id=BPONCX2I7YTZAOYMWFPROYQPPMU7QYNXMCSUO6WOK2O5Z4EABN4A, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.987432437 (249h49m11.58154369s) [noise=true , address=145.79.227.15:4887 , piece_id=OGDTARYMJAMXPO65HMCCF6XX3UOWAIGJEBOUNTESYRSC4XMST7KA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.987664642 (249h49m11.581775894s) [noise=true , address=167.17.72.70:4770 , piece_id=XTN3PS7T3I4GXEKY7GTB7MU6UWYZVDY2XIFPZIEWIYMTL5OSF7QQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.987912337 (249h49m11.58202359s) [noise=true , address=45.91.116.8:4063 , piece_id=ZOEJS2TTZ6BHFZUURJEKFQVUJL6WC3M5VGN3HKIVGQ4C6FLSIEIQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.988175795 (249h49m11.582287095s) [noise=true , address=79.127.205.237:4227 , piece_id=MTNC7R3VKGAKT7AP4OLEAUHXLIPH2SXPT3Y7QAXKWADWQ3COAGSA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.988666600 (249h49m11.582777853s) [noise=true , address=167.17.72.68:4653 , piece_id=A4RANTYY4SEYEXY57WTNWYDKDEAQ4VMTLTDK3Y3BS6BNOGX7OR7A, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.989145396 (249h49m11.583256649s) [noise=true , address=79.127.205.235:4263 , piece_id=HGMMXUONDXPDP75NMPDBQCZVZYQR5RT7TVN7TCJLET4TX5UMFMEQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.989660143 (249h49m11.583771391s) [noise=true , address=145.79.227.13:4831 , piece_id=XF3IRLYB6EGWQRXXPJARX3SM2AOGD6VHZAAPXFSNZMTRPFYEMFBQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.990129570 (249h49m11.584240825s) [noise=true , address=193.149.164.66:4989 , piece_id=FSZBDEUI74MMIXRQLZBXVDWH6K554ROZC4EZ3ESS4EBOHFBEIMZQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.991227989 (249h49m11.585339239s) [noise=true , address=79.127.205.234:4194 , piece_id=J3WXXFSWXESVKG4IUO2BUVS7T5RLK6AGU7EMUHFNHCCO4LE7PMSQ, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:00.991796972 (249h49m11.585908207s) [noise=true , address=145.79.227.5:4250 , piece_id=M2YQJ2YZGZOJBFNC7UZ6N6QODNZGPW6JSEE3AVQZIXUY56TFGVYA, seg_pos={0 0}, upload=240158]: Uploading piece... Apr 18 02:06:01.079630406 (249h49m11.673741659s) [noise=true , address=145.79.227.49:4349 , piece_id=WJPYL3ALQIJ2RLZWICA4VAKVNHTEVDXYE2Q6MDDHZFUFPZMT654A, seg_pos={0 0}, upload=240158]: Done uploading piece. err: ecclient: upload failed (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk, address:145.79.227.49:4349): protocol: rpc: dial tcp 145.79.227.49:4349: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:06:01.152816240 (249h49m11.746927491s) [noise=true , address=167.17.72.68:4653 , piece_id=A4RANTYY4SEYEXY57WTNWYDKDEAQ4VMTLTDK3Y3BS6BNOGX7OR7A, seg_pos={0 0}, upload=240158]: Done uploading piece. err: ecclient: upload failed (node:12fZ7CT6Z273zoviti3xPNBPWq65PWpvoa4WXqd4VQJjFga6phX, address:167.17.72.68:4653): protocol: write tcp 139.59.144.22:53260->167.17.72.68:4653: write: connection refused; write tcp 139.59.144.22:53260->167.17.72.68:4653: write: connection refused; piecestore: piecestore close: conn closed: op Apr 18 02:06:01.594039547 (249h49m12.188150798s) [upload=240158]: Next returned nil segment Apr 18 02:06:01.594065563 (249h49m12.188176813s) [upload=240158]: Waiting for error group managing segments... Apr 18 02:06:01.744244626 (249h49m12.338355882s) [noise=true , address=145.79.227.5:4250 , piece_id=M2YQJ2YZGZOJBFNC7UZ6N6QODNZGPW6JSEE3AVQZIXUY56TFGVYA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:01.775086192 (249h49m12.369197436s) [noise=true , address=145.79.227.40:4081 , piece_id=NZDYG4EVFEVJMGHLKCARM7RCXPPXGVVINRLL2DRENVXW5Y4BQV2Q, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:02.303606102 (249h49m12.897717352s) [noise=true , address=193.149.164.66:4989 , piece_id=FSZBDEUI74MMIXRQLZBXVDWH6K554ROZC4EZ3ESS4EBOHFBEIMZQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:02.396037902 (249h49m12.990149147s) [noise=true , address=79.127.205.234:4194 , piece_id=J3WXXFSWXESVKG4IUO2BUVS7T5RLK6AGU7EMUHFNHCCO4LE7PMSQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:02.519175970 (249h49m13.113287215s) [noise=true , address=79.127.205.235:4263 , piece_id=HGMMXUONDXPDP75NMPDBQCZVZYQR5RT7TVN7TCJLET4TX5UMFMEQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:02.544170306 (249h49m13.13828156s) [noise=true , address=79.127.205.237:4227 , piece_id=MTNC7R3VKGAKT7AP4OLEAUHXLIPH2SXPT3Y7QAXKWADWQ3COAGSA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:02.770447204 (249h49m13.364558451s) [noise=true , address=79.127.205.233:4157 , piece_id=BPONCX2I7YTZAOYMWFPROYQPPMU7QYNXMCSUO6WOK2O5Z4EABN4A, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:04.297406530 (249h49m14.891517781s) [noise=true , address=5.231.73.4:4023 , piece_id=EJZRXYMX3UIO7JXZIDXO5I54GYSNIVEEMJCFEU3OZB6BP4IEGXTQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:05.390173157 (249h49m15.984284406s) [noise=true , address=45.91.116.8:4063 , piece_id=ZOEJS2TTZ6BHFZUURJEKFQVUJL6WC3M5VGN3HKIVGQ4C6FLSIEIQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:06.041667001 (249h49m16.635778269s) [noise=true , address=167.17.72.70:4770 , piece_id=XTN3PS7T3I4GXEKY7GTB7MU6UWYZVDY2XIFPZIEWIYMTL5OSF7QQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:07.308986818 (249h49m17.903098063s) [noise=true , address=167.17.72.69:4743 , piece_id=Z7LC2AVAQI7EXXAVWTQ2POBB6YE4GUE3XV3RVYWXDC36RAHO3EXA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:08.069889598 (249h49m18.664000849s) [noise=true , address=145.79.227.13:4831 , piece_id=XF3IRLYB6EGWQRXXPJARX3SM2AOGD6VHZAAPXFSNZMTRPFYEMFBQ, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:06:09.547140625 (249h49m20.141251879s) [noise=true , address=145.79.227.15:4887 , piece_id=OGDTARYMJAMXPO65HMCCF6XX3UOWAIGJEBOUNTESYRSC4XMST7KA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: <nil> Apr 18 02:07:00.625979070 (249h50m11.220090325s) [noise=true , address=145.79.227.11:4758 , piece_id=D7R5TAQRYAWUHMCA7KKHCGSKISGUYWSYRVRC3ANQJAMYJTOU54KA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: ecclient: upload failed (node:1joBbXdmusUXDfe1ofLp5oXy1nVkkRAng8QGL2hAtKjDz71u5g, address:145.79.227.11:4758): protocol: rpc: dial tcp 145.79.227.11:4758: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:07:00.626384434 (249h50m11.220495689s) [noise=true , address=145.79.227.38:4987 , piece_id=CPACAC467P5XMJT62FBQPKYOSGE6GPH4EKMG2DZI2VSBGMLBBCVA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: ecclient: upload failed (node:1oZxiaBQD1grLu8d1HyERweeuXNXc1aBgyAoe1B86gqm6ypvBC, address:145.79.227.38:4987): protocol: rpc: dial tcp 145.79.227.38:4987: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:07:00.626620292 (249h50m11.220731545s) [noise=true , address=167.17.72.71:4794 , piece_id=NMP5XGESL4DN5YKP4KN5TCA3RUBIYX6SR632ABEMSD6V4JZRRIJA, seg_pos={0 0}, upload=240158]: Done uploading piece. err: ecclient: upload failed (node:1sNGPMY8nuWVLFECNta92W6sqAkSPBKDTMALh6ozm9ro9p94cY, address:167.17.72.71:4794): protocol: write tcp 139.59.144.22:40918->167.17.72.71:4794: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:07:00.626653983 (249h50m11.220765215s) [seg_pos={0 0}, upload=240158]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:07:00.732603698 (249h50m11.326714944s) [upload=240158]: Done uploading segments... Apr 18 02:07:00.732649714 (249h50m11.326760964s) [upload=240158]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.149348787s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [X.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....X] duration: 5.001796961s trace: https://jaeger.dev.storj.io/trace/381c8e88a163e6f4 FAIL (2026-04-18 02:06:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001833789s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.XX..XX.X.....] duration: 4.857613402s trace: https://jaeger.dev.storj.io/trace/32eb960997f77b2a FAIL (2026-04-18 02:06:14 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.857642145s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 17 out of 60 is failed (threshold=3) [..X..X.XX.XX..X.XXX..X.XXXX....X..........X.................] duration: 4.88892564s trace: https://jaeger.dev.storj.io/trace/9a3abeebd2986c0 FAIL (2026-04-18 02:06:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.88894377s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 56 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.XXXXX.XXX.X] duration: 1m0.107835916s trace: https://jaeger.dev.storj.io/trace/4f86a607321b0459 FAIL (2026-04-18 02:06:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== .208160754s) [upload=240144]: Got next segment. Inline: false Apr 18 02:05:00.614165061 (249h48m11.208276314s) [upload=240144]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 18 02:05:00.614175965 (249h48m11.208287222s) [upload=240144]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 18 02:05:00.722526507 (249h48m11.316637759s) [seg_pos={0 0}, upload=240144]: Begin upload segment... Apr 18 02:05:00.722597667 (249h48m11.316708922s) [seg_pos={0 0}, upload=240144]: Done begin upload segment. Apr 18 02:05:00.722631150 (249h48m11.316742395s) [noise=true , address=79.127.205.233:4158 , piece_id=UDGL3RNYC4EAIWS63CRPTCS5SGFNXQFSNHQOKDNRUAVK65BDKLEQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.722673313 (249h48m11.316784563s) [noise=true , address=45.91.116.5:4318 , piece_id=U7GY6PX3FUZ5GJT4UV6AW3EZ5AB7D5TKKMTR42AFRN7OVU7QWLWQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.723621685 (249h48m11.317732942s) [noise=true , address=77.90.31.14:4694 , piece_id=7OMX5PKIKXWCAVYVYS2BV22QO7XQSFZBJYVSKGTGN75E3GAPO53Q, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.723863774 (249h48m11.317975035s) [noise=true , address=167.17.72.69:4725 , piece_id=YVZOZ545SN253SLNOQSHFF3B6MAFOFMBUYR66LPF2OVN5SANOPEA, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.724661984 (249h48m11.318773236s) [noise=true , address=167.17.72.68:4646 , piece_id=AGRS7AJRIQWZ4N3LNUR3OIHWIHJW75IDNNZ3YPBVGLCFA4ICQNHA, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.724922010 (249h48m11.319033263s) [noise=true , address=193.149.164.66:4995 , piece_id=4OHMCAJRULYMOG7IZKDXSRAFAFTVHEO5GKNQ5YASSE3LDUGOOW5A, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.725284669 (249h48m11.31939592s) [noise=true , address=193.149.164.71:4297 , piece_id=PW4DXIIOPUY2JMMULA7WTUW2Z3UTTOXHFELKP7ZTO2ZYSTERHFCA, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.725421459 (249h48m11.319532712s) [noise=true , address=193.149.164.143:4696 , piece_id=RRUJOLVTC2IFFNUIYHX2EEXZXPFA24ZY77IZ35UPZFXYOZTKZ2UQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.725705092 (249h48m11.319816343s) [noise=true , address=145.79.227.32:4840 , piece_id=COF6ULH7EXVYWA5LDONFWNIPKRUUF7W3UESU4BI6YINIL7JCLGJQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.725953363 (249h48m11.320064614s) [noise=true , address=167.17.72.71:4805 , piece_id=GLCEJDE2AYUOW5DX5667XWGUPGY7XNXKRFSTT4YAGGUF43IWNXCA, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.726417480 (249h48m11.320528723s) [noise=true , address=145.79.227.9:4399 , piece_id=UHKP4UVG2MKFZMZQAKMTGO3QD26YIRS7KZOROX7VLSFRYTP5VNRQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.726434146 (249h48m11.320545399s) [noise=true , address=79.127.205.234:4211 , piece_id=MVJEUKUVWKUDIXNLMYYSUGKKFSRZ6QW4H34K4YU4GPWNMU5AEUDQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.726903957 (249h48m11.321015209s) [noise=true , address=145.79.227.11:4759 , piece_id=MBOKNHNHS42NIC3Q5GYZ2PS3SYRPWX2CJRFBREPPTSNA5MXY7QOA, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.727038826 (249h48m11.321150076s) [noise=true , address=167.17.72.70:4756 , piece_id=OGSD4LCVTSNSRJN4537FSIXHFAOIKRIPW7LJRJKLUNWFJCBUSZ4Q, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.727596321 (249h48m11.321707573s) [noise=true , address=77.90.31.17:4777 , piece_id=6M2M7SHDIQXWQMRHC6X5SMR33HAF3QVIJ3E2PG3WYXFPV277SC6A, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.727671971 (249h48m11.321783221s) [noise=true , address=79.127.205.235:4253 , piece_id=XKK6YQIJQ4XI6CECLQFJG3Q56QJWL4UOZXV7LQ4RQUXVS7QG2AZQ, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.728086452 (249h48m11.322197704s) [noise=true , address=79.127.205.237:4224 , piece_id=QG3EKCUJE6F4KPEDT2UZNXIWP2WGEK3XPEFDXS23DGHSBGJFDH6Q, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.728226320 (249h48m11.322337568s) [noise=true , address=145.79.227.49:4365 , piece_id=E3UHTDVVM47ESHTRTHLLDMSULMG6VXGT577O3233I7U3COJFDDOA, seg_pos={0 0}, upload=240144]: Uploading piece... Apr 18 02:05:00.818015393 (249h48m11.41212664s) [noise=true , address=145.79.227.49:4365 , piece_id=E3UHTDVVM47ESHTRTHLLDMSULMG6VXGT577O3233I7U3COJFDDOA, seg_pos={0 0}, upload=240144]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:05:00.884682069 (249h48m11.478793318s) [noise=true , address=167.17.72.69:4725 , piece_id=YVZOZ545SN253SLNOQSHFF3B6MAFOFMBUYR66LPF2OVN5SANOPEA, seg_pos={0 0}, upload=240144]: Done uploading piece. err: ecclient: upload failed (node:1FgFAvkTus7ri5TcLGjMv2LVMa5e4fYsj898RSyjdn1EGBEs51, address:167.17.72.69:4725): protocol: write tcp 139.59.144.22:37010->167.17.72.69:4725: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:05:00.899429861 (249h48m11.493541112s) [noise=true , address=193.149.164.143:4696 , piece_id=RRUJOLVTC2IFFNUIYHX2EEXZXPFA24ZY77IZ35UPZFXYOZTKZ2UQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: ecclient: upload failed (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy, address:193.149.164.143:4696): protocol: write tcp 139.59.144.22:38740->193.149.164.143:4696: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:05:01.311267168 (249h48m11.905378435s) [upload=240144]: Next returned nil segment Apr 18 02:05:01.311288036 (249h48m11.90539929s) [upload=240144]: Waiting for error group managing segments... Apr 18 02:05:01.468074411 (249h48m12.062185654s) [noise=true , address=145.79.227.32:4840 , piece_id=COF6ULH7EXVYWA5LDONFWNIPKRUUF7W3UESU4BI6YINIL7JCLGJQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:01.469552779 (249h48m12.063664022s) [noise=true , address=45.91.116.5:4318 , piece_id=U7GY6PX3FUZ5GJT4UV6AW3EZ5AB7D5TKKMTR42AFRN7OVU7QWLWQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:01.871656712 (249h48m12.465767963s) [noise=true , address=167.17.72.71:4805 , piece_id=GLCEJDE2AYUOW5DX5667XWGUPGY7XNXKRFSTT4YAGGUF43IWNXCA, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:02.072220654 (249h48m12.666331905s) [noise=true , address=79.127.205.237:4224 , piece_id=QG3EKCUJE6F4KPEDT2UZNXIWP2WGEK3XPEFDXS23DGHSBGJFDH6Q, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:02.107989044 (249h48m12.702100296s) [noise=true , address=79.127.205.234:4211 , piece_id=MVJEUKUVWKUDIXNLMYYSUGKKFSRZ6QW4H34K4YU4GPWNMU5AEUDQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:02.108931660 (249h48m12.703042904s) [noise=true , address=79.127.205.233:4158 , piece_id=UDGL3RNYC4EAIWS63CRPTCS5SGFNXQFSNHQOKDNRUAVK65BDKLEQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:02.126358865 (249h48m12.720470113s) [noise=true , address=193.149.164.71:4297 , piece_id=PW4DXIIOPUY2JMMULA7WTUW2Z3UTTOXHFELKP7ZTO2ZYSTERHFCA, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:02.430143142 (249h48m13.024254387s) [noise=true , address=193.149.164.66:4995 , piece_id=4OHMCAJRULYMOG7IZKDXSRAFAFTVHEO5GKNQ5YASSE3LDUGOOW5A, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:02.465449486 (249h48m13.05956075s) [noise=true , address=79.127.205.235:4253 , piece_id=XKK6YQIJQ4XI6CECLQFJG3Q56QJWL4UOZXV7LQ4RQUXVS7QG2AZQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:05.802304973 (249h48m16.396416201s) [noise=true , address=77.90.31.14:4694 , piece_id=7OMX5PKIKXWCAVYVYS2BV22QO7XQSFZBJYVSKGTGN75E3GAPO53Q, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:06.231325646 (249h48m16.825436888s) [noise=true , address=77.90.31.17:4777 , piece_id=6M2M7SHDIQXWQMRHC6X5SMR33HAF3QVIJ3E2PG3WYXFPV277SC6A, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:09.280155297 (249h48m19.874266536s) [noise=true , address=145.79.227.9:4399 , piece_id=UHKP4UVG2MKFZMZQAKMTGO3QD26YIRS7KZOROX7VLSFRYTP5VNRQ, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:05:12.837122778 (249h48m23.431234021s) [noise=true , address=167.17.72.70:4756 , piece_id=OGSD4LCVTSNSRJN4537FSIXHFAOIKRIPW7LJRJKLUNWFJCBUSZ4Q, seg_pos={0 0}, upload=240144]: Done uploading piece. err: <nil> Apr 18 02:06:00.330069318 (249h49m10.924180564s) [noise=true , address=145.79.227.11:4759 , piece_id=MBOKNHNHS42NIC3Q5GYZ2PS3SYRPWX2CJRFBREPPTSNA5MXY7QOA, seg_pos={0 0}, upload=240144]: Done uploading piece. err: ecclient: upload failed (node:12RFJ2jqXCSsXgc8ZDNTptWcaUV5Lm25Eobt58t7vGiQY34uhXz, address:145.79.227.11:4759): protocol: rpc: dial tcp 145.79.227.11:4759: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 18 02:06:00.330300967 (249h49m10.924412221s) [noise=true , address=167.17.72.68:4646 , piece_id=AGRS7AJRIQWZ4N3LNUR3OIHWIHJW75IDNNZ3YPBVGLCFA4ICQNHA, seg_pos={0 0}, upload=240144]: Done uploading piece. err: ecclient: upload failed (node:12PqAjcGb2g9w5yHp6Sd432wofz9jKWK9hRRTxLzzv2BAFL1iRW, address:167.17.72.68:4646): protocol: write tcp 139.59.144.22:46626->167.17.72.68:4646: use of closed network connection; conn closed: op Apr 18 02:06:00.330362333 (249h49m10.924473562s) [seg_pos={0 0}, upload=240144]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 18 02:06:00.434981360 (249h49m11.029092606s) [upload=240144]: Done uploading segments... Apr 18 02:06:00.435024729 (249h49m11.029135978s) [upload=240144]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.107868584s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)