Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.078814474s FAIL (2025-08-12 05:45:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.078843552s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X..X...............X.........X...........X.................] duration: 2.558285396s FAIL (2025-08-12 05:44:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.558346209s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 826.629451ms FAIL (2025-08-12 05:44:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 826.656531ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X..X...............X.........X...........X................] duration: 2.373567909s FAIL (2025-08-12 05:44:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.373603824s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.242438997s FAIL (2025-08-12 05:44:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.242467674s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 891.386685ms FAIL (2025-08-12 05:44:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 891.420642ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X..X...............X.........X...........X...............] duration: 2.480408031s FAIL (2025-08-12 05:43:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.480450255s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 834.531898ms FAIL (2025-08-12 05:43:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 834.560993ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.331217642s FAIL (2025-08-12 05:43:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.33124446s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.010150756s FAIL (2025-08-12 05:43:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.010273749s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 821.518715ms FAIL (2025-08-12 05:43:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 821.572545ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X..X...............X.........X...........X..............] duration: 2.300510594s FAIL (2025-08-12 05:42:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.300540491s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 829.656379ms FAIL (2025-08-12 05:42:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 829.705317ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.086264677s FAIL (2025-08-12 05:42:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.086288344s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X..X...............X.........X...........X.............] duration: 2.412304238s FAIL (2025-08-12 05:42:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.412353463s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.17068636s FAIL (2025-08-12 05:41:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.170703893s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 824.747498ms FAIL (2025-08-12 05:41:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 824.848247ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X..X...............X.........X...........X............] duration: 2.517982015s FAIL (2025-08-12 05:40:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.518016337s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.145425974s FAIL (2025-08-12 05:40:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.145456461s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 821.0417ms FAIL (2025-08-12 05:40:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 821.073944ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X..X...............X.........X...........X...........] duration: 2.550864066s FAIL (2025-08-12 05:40:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.550897805s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.058757851s FAIL (2025-08-12 05:40:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.058827982s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.084501643s FAIL (2025-08-12 05:40:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.0845274s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X..X...............X.........X...........X..........] duration: 2.429311334s FAIL (2025-08-12 05:40:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.429350568s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 820.55216ms FAIL (2025-08-12 05:39:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 820.577542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 822.056998ms FAIL (2025-08-12 05:39:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 822.098446ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 997.632863ms FAIL (2025-08-12 05:39:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 997.657287ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X..X...............X.........X...........X.........] duration: 2.321553625s FAIL (2025-08-12 05:39:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.321588077s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.145630283s FAIL (2025-08-12 05:39:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.145655038s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 832.752494ms FAIL (2025-08-12 05:38:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 832.788155ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X..X...............X.........X...........X........] duration: 2.401266119s FAIL (2025-08-12 05:38:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.401298094s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.079796421s FAIL (2025-08-12 05:38:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.079835549s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........X..X...............X.........X...........X.......] duration: 2.311241524s FAIL (2025-08-12 05:37:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.311274623s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 813.515981ms FAIL (2025-08-12 05:37:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 813.545071ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.122332478s FAIL (2025-08-12 05:37:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.122352481s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [............X..X...............X.........X...........X......] duration: 2.562997062s FAIL (2025-08-12 05:37:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.563019772s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 817.104304ms FAIL (2025-08-12 05:36:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 817.137648ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.130984686s FAIL (2025-08-12 05:36:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.131020318s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X..X...............X.........X...........X.....] duration: 2.5377145s FAIL (2025-08-12 05:36:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.53774306s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.33875926s FAIL (2025-08-12 05:36:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.338781495s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 851.667401ms FAIL (2025-08-12 05:36:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 851.703222ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X..X...............X.........X...........X....] duration: 2.45150997s FAIL (2025-08-12 05:35:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.451544878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.073296406s FAIL (2025-08-12 05:35:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.073337933s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.012003591s FAIL (2025-08-12 05:34:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.012048933s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 890.211461ms FAIL (2025-08-12 05:34:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 890.246819ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X..X...............X.........X...........X...] duration: 2.526902564s FAIL (2025-08-12 05:34:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.526938664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.076953355s FAIL (2025-08-12 05:34:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.07698013s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 914.856359ms FAIL (2025-08-12 05:33:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 914.906125ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [................X..X...............X.........X...........X..] duration: 2.594190757s FAIL (2025-08-12 05:33:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.594307317s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.039136106s FAIL (2025-08-12 05:33:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.03916338s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)