Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.031267107s FAIL (2025-08-12 05:32:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.031295002s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 705.603432ms FAIL (2025-08-12 05:32:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 05:32:44.691257912 (84h7m6.650355146s) [upload=87684]: Starting upload Aug 12 05:32:44.691369094 (84h7m6.650466347s) [upload=87684]: Done starting upload Aug 12 05:32:44.691451789 (84h7m6.650549027s) [upload=87684]: Uploading segments... Aug 12 05:32:44.691546842 (84h7m6.650644079s) [upload=87684]: Got next segment. Inline: true Aug 12 05:32:44.691554024 (84h7m6.65065127s) [upload=87684]: Waiting for error group managing segments... Aug 12 05:32:44.691631705 (84h7m6.650728955s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:32:44.691638863 (84h7m6.650736119s) [upload=87684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 05:32:44.691643007 (84h7m6.650740252s) [upload=87684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:32:44.923066456 (84h7m6.882163689s) [upload=87684]: Done uploading segments... Aug 12 05:32:44.923086593 (84h7m6.882183825s) [upload=87684]: Upload finished. err: <nil> Duration:* 705.633516ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................X..X...............X.........X...........X.] duration: 2.435801731s FAIL (2025-08-12 05:32:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 2.435830608s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.232054207s FAIL (2025-08-12 05:32:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.232078672s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................X..X...............X.........X...........X] duration: 1.591981326s FAIL (2025-08-12 05:31:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:31:44.965303335 (84h6m6.924400567s) [upload=87666]: Starting upload Aug 12 05:31:44.965359189 (84h6m6.924456433s) [upload=87666]: Done starting upload Aug 12 05:31:44.965466705 (84h6m6.92456394s) [upload=87666]: Uploading segments... Aug 12 05:31:44.965625395 (84h6m6.924722625s) [upload=87666]: Got next segment. Inline: false Aug 12 05:31:44.965681098 (84h6m6.92477833s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:31:44.965686011 (84h6m6.924783257s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:31:45.165122829 (84h6m7.124220066s) [seg_pos={0 0}, upload=87666]: Begin upload segment... Aug 12 05:31:45.165188628 (84h6m7.124285866s) [seg_pos={0 0}, upload=87666]: Done begin upload segment. Aug 12 05:31:45.165228988 (84h6m7.124326236s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.165798923 (84h6m7.124896158s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166043472 (84h6m7.125140724s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166279536 (84h6m7.125376791s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166489864 (84h6m7.125587118s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166907443 (84h6m7.126004703s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.166991334 (84h6m7.126088583s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167374559 (84h6m7.126471813s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167401952 (84h6m7.126499206s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167706358 (84h6m7.12680361s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167802242 (84h6m7.126899487s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.167978219 (84h6m7.127075469s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168165724 (84h6m7.12726297s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168391720 (84h6m7.127488974s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.168722717 (84h6m7.127819962s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169127181 (84h6m7.128224439s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169466407 (84h6m7.128563661s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.169865623 (84h6m7.128962869s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Uploading piece... Aug 12 05:31:45.741059185 (84h6m7.70015643s) [upload=87666]: Next returned nil segment Aug 12 05:31:45.741077282 (84h6m7.700174518s) [upload=87666]: Waiting for error group managing segments... Aug 12 05:31:45.888126509 (84h6m7.847223743s) [noise=true , address=77.90.31.18:4811 , piece_id=6XLZ2PWGVISJUFZECC6E5FBQOLRBWJOE57EIKA5DEKV7CKLUSDZA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.891092515 (84h6m7.850189749s) [noise=true , address=104.36.82.37:4684 , piece_id=HD7HVGRZXMFG5B3H2UDPY5YG5ZKL5TZM4ZKZCZUOQV5XR3TWJMRA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892592968 (84h6m7.851690206s) [noise=true , address=104.36.82.58:4285 , piece_id=TCZAET7LJBC7EE2XYFXJ6P423UAYEE4Q4DBBET4AAJRPR6LUDMAA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.892995650 (84h6m7.852092885s) [noise=true , address=104.36.82.62:4415 , piece_id=LNK3UUH3KEHTWGU37QAZGZCT2QXMSDNXAYH4SNW6SWFAOXTLZUJA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893171414 (84h6m7.852268652s) [noise=true , address=104.36.82.34:4556 , piece_id=DLZJ67LHUCHUAMBXJO4TD5ZEPITMWJRLL4PWVDY5NC5XSMNJDZ2Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.893498774 (84h6m7.852596011s) [noise=true , address=104.36.82.39:4726 , piece_id=2RWLGYOLVHRFRU33JQQAWOF4WN24U7BB3NGF535KN3NBSPYGYUQA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.895323522 (84h6m7.854420758s) [noise=true , address=104.36.82.18:4372 , piece_id=MS2CPD7UNQCWDPM3S5MCKMXDX3T4LKC354FIY2OIS66UTTJV2UOQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.898927068 (84h6m7.858024305s) [noise=true , address=104.36.82.51:4054 , piece_id=OZ3GMGBASIPK3N6MY4MQWVIQGHIZRJETWPQAJYLIUBJ63U4M3TUA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.901634358 (84h6m7.860731617s) [noise=true , address=104.36.82.4:4825 , piece_id=6SKAC6QV7EWBCUX5OETOBBOSQIQPWEUIH5WHAIBU5EPPFCE4FVSA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.908786458 (84h6m7.867883692s) [noise=true , address=104.36.82.35:4612 , piece_id=SDGYRE6FHAEYKSBUFLPK7Q3FEAODTYHCG6VZPBXTUSBOZD7MJHWQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.914639175 (84h6m7.873736417s) [noise=true , address=104.36.82.21:4496 , piece_id=IFVFBNLSCCNL3KHTQKF5Q5DPE5EPFA4NKTY46BGNWG2OV5GIXYSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.915725681 (84h6m7.874822928s) [noise=true , address=104.36.82.23:4459 , piece_id=O56RQ3VW3RRVIQ5K5TUVER7EMRZB5PVENSU7BMKC5QD4IP52H67A, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.923222318 (84h6m7.88231956s) [noise=true , address=104.36.82.45:4917 , piece_id=WVPUAFNOBKPSXWRW35I3DCEOGBCUPN35W5RCTZMB7YSQAWKIO77Q, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929797372 (84h6m7.888894623s) [noise=true , address=104.36.82.60:4357 , piece_id=E27W3LVV3LUOUU3LAJ4BMVTEKO32RH5DD25N55EGHWACD7OPNMFA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: <nil> Aug 12 05:31:45.929824757 (84h6m7.888922004s) [seg_pos={0 0}, upload=87666]: Segment reached optimal threshold of 14 pieces. Aug 12 05:31:45.930040601 (84h6m7.889137845s) [noise=true , address=104.36.82.17:4354 , piece_id=ZIT33U6A6TEVNRMY72BZV6TZRQB2R2C5OXTI7FAQFYW63NCYIGSQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16LBUBhBQLy2yyVYjwhFtoahB9nE2KDyHvNWbdw7zXC1RgHjdh): protocol: expected piece hash; context canceled; EOF Aug 12 05:31:45.930212210 (84h6m7.889309441s) [noise=true , address=64.49.13.169:4707 , piece_id=GGCL7GC2N37BX4AOSVVAW4W2ELTV2IGHDIU5QFQTU7D2PEDOGEQQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59686->64.49.13.169:4707: use of closed network connection Aug 12 05:31:45.930274889 (84h6m7.889372119s) [noise=true , address=66.23.193.175:4556 , piece_id=NBUTYATGLFRLWXS6MFRHO5TWKHL5MI2QMDDVI55VKGUKOXI4ZYXQ, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49148->66.23.193.175:4556: use of closed network connection Aug 12 05:31:45.930287565 (84h6m7.889384797s) [noise=true , address=64.49.13.154:4930 , piece_id=FHRXSFNOK2W2IA742MKELLLJ4SMZGEV74RFWJUFL4TSVJ4FMC3OA, seg_pos={0 0}, upload=87666]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41412->64.49.13.154:4930: use of closed network connection Aug 12 05:31:45.930303651 (84h6m7.889400882s) [seg_pos={0 0}, upload=87666]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:31:45.930372262 (84h6m7.889469493s) [upload=87666]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:31:45.930376653 (84h6m7.889473898s) [upload=87666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:31:46.089894495 (84h6m8.048991743s) [upload=87666]: Done uploading segments... Aug 12 05:31:46.089944817 (84h6m8.049042056s) [upload=87666]: Upload finished. err: <nil> Duration: 1.592090502s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.003091302s FAIL (2025-08-12 05:31:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.003109584s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X..X...............X.........X...........] duration: 2.359441293s FAIL (2025-08-12 05:31:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.35947413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.136784048s FAIL (2025-08-12 05:30:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.136830268s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.091635481s FAIL (2025-08-12 05:30:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.091656854s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X..X...............X.........X..........] duration: 2.434616541s FAIL (2025-08-12 05:30:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.434729358s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.030888935s FAIL (2025-08-12 05:29:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.030920084s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X..X...............X.........X.........] duration: 2.508573119s FAIL (2025-08-12 05:28:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.508612038s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.074291513s FAIL (2025-08-12 05:28:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.074320179s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X..X...............X.........X........] duration: 2.492054133s FAIL (2025-08-12 05:28:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.492093625s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.192115613s FAIL (2025-08-12 05:27:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.192144578s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..X...............X.........X.......] duration: 2.315834888s FAIL (2025-08-12 05:27:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.315945244s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 996.356747ms FAIL (2025-08-12 05:26:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 996.420579ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.08994698s FAIL (2025-08-12 05:26:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.089971878s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.062638024s FAIL (2025-08-12 05:26:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.062659953s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X..X...............X.........X......] duration: 2.48732542s FAIL (2025-08-12 05:26:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.487361052s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.058624119s FAIL (2025-08-12 05:25:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.058642415s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X..X...............X.........X.....] duration: 2.62920455s FAIL (2025-08-12 05:25:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.629303845s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.017140755s FAIL (2025-08-12 05:24:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.01716501s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X..X...............X.........X....] duration: 2.825151671s FAIL (2025-08-12 05:24:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.825237862s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................X..X...............X.........X...] duration: 2.90172877s FAIL (2025-08-12 05:24:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.901758843s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.041900478s FAIL (2025-08-12 05:23:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.041933846s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X..X...............X.........X..] duration: 2.310278408s FAIL (2025-08-12 05:23:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.310417821s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.284566898s FAIL (2025-08-12 05:23:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.284594067s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.084218837s FAIL (2025-08-12 05:22:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.084243147s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................X..X...............X.........X.] duration: 2.389284411s FAIL (2025-08-12 05:22:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 2.38932374s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 856.936566ms FAIL (2025-08-12 05:22:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 856.968501ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................X..X...............X.........X] duration: 1.627274348s FAIL (2025-08-12 05:21:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:21:55.204342555 (83h56m17.163439793s) [upload=87498]: Starting upload Aug 12 05:21:55.204430546 (83h56m17.163527799s) [upload=87498]: Done starting upload Aug 12 05:21:55.204583600 (83h56m17.163680832s) [upload=87498]: Uploading segments... Aug 12 05:21:55.204905069 (83h56m17.1640023s) [upload=87498]: Got next segment. Inline: false Aug 12 05:21:55.204958115 (83h56m17.164055361s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:21:55.204964788 (83h56m17.164062034s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:21:55.414307760 (83h56m17.373405005s) [seg_pos={0 0}, upload=87498]: Begin upload segment... Aug 12 05:21:55.414361010 (83h56m17.373458255s) [seg_pos={0 0}, upload=87498]: Done begin upload segment. Aug 12 05:21:55.414404081 (83h56m17.373501327s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414413090 (83h56m17.373510336s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414758001 (83h56m17.373855248s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.414827776 (83h56m17.373925028s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415276682 (83h56m17.374373929s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415324232 (83h56m17.374421481s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415590806 (83h56m17.374688054s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.415865214 (83h56m17.37496246s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416143454 (83h56m17.37524069s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416479417 (83h56m17.37557667s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.416794821 (83h56m17.375892072s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417074723 (83h56m17.376171971s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417408854 (83h56m17.376506106s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.417713847 (83h56m17.376811086s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.420568992 (83h56m17.379666263s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.422249788 (83h56m17.381347037s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.424403191 (83h56m17.383500437s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.429212345 (83h56m17.388309599s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Uploading piece... Aug 12 05:21:55.986493167 (83h56m17.945590422s) [upload=87498]: Next returned nil segment Aug 12 05:21:55.986516976 (83h56m17.945614236s) [upload=87498]: Waiting for error group managing segments... Aug 12 05:21:56.141749163 (83h56m18.100846402s) [noise=true , address=77.90.31.13:4659 , piece_id=3YFNIKGLQSWT7L3GGL3K2U6QTDEQXK4NBDEZWXR3QYLIDPINAFQQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.142849128 (83h56m18.101946366s) [noise=true , address=77.90.31.11:4567 , piece_id=UNMSGX34YRM47LFS5MXNZUYDU2UOFWCWLRHU26DWI5A3MKGIEX6Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144321611 (83h56m18.103418849s) [noise=true , address=104.36.82.23:4447 , piece_id=JCWGG72XBW4ZA6VAAY4GNYFWV4OUED2DJDHOOCNBD6HADZY6WBSA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.144837404 (83h56m18.103934641s) [noise=true , address=104.36.82.40:4943 , piece_id=QW3U5KTIV2HUF7JX7E6R2ZNWEVSIG4BW4G3I3VUZ7QBDUB75YLVA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.153771031 (83h56m18.11286828s) [noise=true , address=104.36.82.39:4729 , piece_id=3V4P7RD2YRCXMBMFSNQ5YBRQXLTFBU5PZWO5PLBB2GTUHBDRHPFA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154316957 (83h56m18.113414204s) [noise=true , address=104.36.82.21:4501 , piece_id=BY2AWOZMR6Y4TDH2XBSDED5QDMOROG7RBBU2UEVXNSMJZZC6ZYEA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154380644 (83h56m18.113477886s) [noise=true , address=104.36.82.2:4740 , piece_id=GP7IO3P3RMYI3HEO47ZFKR34PVADBN4WESYYZHYMQLI32GEGUO6A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.154759498 (83h56m18.113856736s) [noise=true , address=104.36.82.5:4857 , piece_id=7JJIOJ4QQF4G4SR3LYJPOKUG2FHRZLSPVJYZU5ZDKWCFRFDNRB4A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155025020 (83h56m18.114122257s) [noise=true , address=104.36.82.38:4693 , piece_id=2QEEHWUQK6HBMCDMDDJ4KSHLI6YTRWEWUDUDQWQMK4G3WD37F7UA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155272977 (83h56m18.114370216s) [noise=true , address=104.36.82.35:4585 , piece_id=NBRMGH67IMSAR3MZ5AGZZXQ4Z5BAGG6D4IBEBWHUQ32EGNO4ENBA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155316925 (83h56m18.114414165s) [noise=true , address=104.36.82.12:4153 , piece_id=WMLOUQY3GL32TWGIY2SYBQXWSTE6B5SL42CFM4CIIMMBYTAQGYGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.155460454 (83h56m18.114557694s) [noise=true , address=104.36.82.22:4522 , piece_id=XTKJXTHZWLFMDHEURPTT36YKQ4LHMFVNZ25MED2QUFIN7EZPYRGQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.159116541 (83h56m18.118213788s) [noise=true , address=104.36.82.18:4377 , piece_id=CYQMQPIUFMJI2ME6OT3FHYOHUF6FV7ROA24MCPORARGIY42OPA2Q, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160764587 (83h56m18.119861819s) [noise=true , address=104.36.82.60:4371 , piece_id=XH6LX2FS25PZEUCAVWCHNSMLFYPO36BTZGAL6RZF7SVLYPNSH5YQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.160778996 (83h56m18.119876227s) [seg_pos={0 0}, upload=87498]: Segment reached optimal threshold of 14 pieces. Aug 12 05:21:56.160974958 (83h56m18.120072202s) [noise=true , address=79.127.219.38:4016 , piece_id=TVUNK733ET74WUC26HYC2UGR7A5QUFPOTGGCQL7SSJRI5DP6TC2A, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161025263 (83h56m18.120122494s) [noise=true , address=79.127.220.101:4066 , piece_id=FWPGBFAGTSQIZT3WLJHK7FQLBXBFE5C3SCWI2OVIP4DPRQR7NLJA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF Aug 12 05:21:56.161150075 (83h56m18.120247307s) [noise=true , address=64.49.13.154:4930 , piece_id=EKKCL2XNGHBXCQYILZ2KM5IWRPE22OO2LMPOIEHQ3FP4QQ325UTA, seg_pos={0 0}, upload=87498]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51020->64.49.13.154:4930: use of closed network connection Aug 12 05:21:56.161182522 (83h56m18.120279772s) [noise=true , address=104.36.82.8:4994 , piece_id=IRHBHYEQ6ZIP5NBD4Y4NCALYDT6QZGSXXNKGOGVCMLXGW2H3WUDQ, seg_pos={0 0}, upload=87498]: Done uploading piece. err: <nil> Aug 12 05:21:56.161224524 (83h56m18.120321777s) [seg_pos={0 0}, upload=87498]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 12 05:21:56.161322540 (83h56m18.12041979s) [upload=87498]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:21:56.161329355 (83h56m18.120426608s) [upload=87498]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:21:56.332023031 (83h56m18.291120276s) [upload=87498]: Done uploading segments... Aug 12 05:21:56.332045692 (83h56m18.291142928s) [upload=87498]: Upload finished. err: <nil> Duration: 1.627318717s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.097592614s FAIL (2025-08-12 05:21:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.097623744s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 823.903053ms FAIL (2025-08-12 05:21:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 823.937165ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.088893256s FAIL (2025-08-12 05:21:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.088906354s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..X...............X.........] duration: 2.617980759s FAIL (2025-08-12 05:21:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.61802701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 837.69939ms FAIL (2025-08-12 05:20:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 837.737825ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X..X...............X........] duration: 2.337425965s FAIL (2025-08-12 05:20:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.337459487s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.246034096s FAIL (2025-08-12 05:20:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.246136227s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..X...............X.......] duration: 2.256575125s FAIL (2025-08-12 05:20:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.256694613s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.005929022s FAIL (2025-08-12 05:20:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.005955872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..X...............X......] duration: 2.867660507s FAIL (2025-08-12 05:20:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.867697737s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 953.707355ms FAIL (2025-08-12 05:19:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 953.737219ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.09458701s FAIL (2025-08-12 05:19:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.094612073s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 861.210876ms FAIL (2025-08-12 05:19:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 861.243902ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X..X...............X.....] duration: 2.428392955s FAIL (2025-08-12 05:18:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.428421548s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.049078211s FAIL (2025-08-12 05:18:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.049105886s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X..X...............X....] duration: 2.489104194s FAIL (2025-08-12 05:18:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.489202863s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.490001375s FAIL (2025-08-12 05:18:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.490025515s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.031335859s FAIL (2025-08-12 05:18:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.031371428s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)