Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.............................X.........................] duration:
2.442336986s
FAIL (2025-08-10 08:46:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.442380098s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X....X.............................X........................] duration:
2.251733387s
FAIL (2025-08-10 08:45:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.251774329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.....................X....................X.........] duration:
883.518383ms
FAIL (2025-08-10 08:45:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.547203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.....................X....................X........] duration:
866.634526ms
FAIL (2025-08-10 08:44:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.674316ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.....................X....................X.......] duration:
834.392812ms
FAIL (2025-08-10 08:44:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.486344ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X....X.............................X.......................] duration:
2.302604471s
FAIL (2025-08-10 08:44:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.30263421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.....................X....................X......] duration:
850.455633ms
FAIL (2025-08-10 08:44:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 850.488962ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X....X.............................X......................] duration:
2.283723682s
FAIL (2025-08-10 08:43:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.283767679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X..........X.....................X....................X.....] duration:
941.330486ms
FAIL (2025-08-10 08:43:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 941.356467ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X....X.............................X.....................] duration:
2.307987831s
FAIL (2025-08-10 08:42:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.308011886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X....X.............................X....................] duration:
2.339912229s
FAIL (2025-08-10 08:42:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.339949027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X..........X.....................X....................X....] duration:
890.928556ms
FAIL (2025-08-10 08:42:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.955291ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X....X.............................X...................] duration:
2.327173556s
FAIL (2025-08-10 08:41:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.327214685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X..........X.....................X....................X...] duration:
862.125274ms
FAIL (2025-08-10 08:41:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.159135ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X....X.............................X..................] duration:
2.409848774s
FAIL (2025-08-10 08:40:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.409882371s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X.....................X....................X..] duration:
819.333452ms
FAIL (2025-08-10 08:40:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.446007ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X....X.............................X.................] duration:
2.348301139s
FAIL (2025-08-10 08:39:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.34833214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..........X.....................X....................X.] duration:
830.267126ms
FAIL (2025-08-10 08:39:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.317137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........X.....................X....................X] duration:
356.997061ms
FAIL (2025-08-10 08:39:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 357.025056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.......X....X.............................X................] duration:
2.387462988s
FAIL (2025-08-10 08:39:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.387499671s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..........X.....................X....................] duration:
802.304088ms
FAIL (2025-08-10 08:38:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 802.333101ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.......X....X.............................X...............] duration:
2.275092549s
FAIL (2025-08-10 08:38:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.275124957s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........X.....................X...................] duration:
837.675568ms
FAIL (2025-08-10 08:38:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 837.704242ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..........X.....................X..................] duration:
886.3511ms
FAIL (2025-08-10 08:37:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 886.380048ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.......X....X.............................X..............] duration:
2.33983666s
FAIL (2025-08-10 08:37:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.339877716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........X.....................X.................] duration:
814.289313ms
FAIL (2025-08-10 08:36:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 814.336479ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.......X....X.............................X.............] duration:
2.302784492s
FAIL (2025-08-10 08:36:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.302814978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.......X....X.............................X............] duration:
2.420091597s
FAIL (2025-08-10 08:36:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.42011841s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........X.....................X................] duration:
813.229194ms
FAIL (2025-08-10 08:35:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 813.258316ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X....X.......X....X.............................X...........] duration:
2.257108376s
FAIL (2025-08-10 08:35:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.257146436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........X.....................X...............] duration:
1.070570332s
FAIL (2025-08-10 08:35:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 1.070601914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X....X.......X....X.............................X..........] duration:
2.301121465s
FAIL (2025-08-10 08:35:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.30114996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..........X.....................X..............] duration:
863.792167ms
FAIL (2025-08-10 08:34:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 863.818362ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X....X.......X....X.............................X.........] duration:
2.29821358s
FAIL (2025-08-10 08:34:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.298241807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........X.....................X.............] duration:
988.551393ms
FAIL (2025-08-10 08:34:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 988.579966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X....X.......X....X.............................X........] duration:
2.464363764s
FAIL (2025-08-10 08:33:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.464396186s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........X.....................X............] duration:
835.719575ms
FAIL (2025-08-10 08:32:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 835.758526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X...X....X.......X....X.............................X.......] duration:
2.43710389s
FAIL (2025-08-10 08:32:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.437138965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..........X.....................X...........] duration:
867.531723ms
FAIL (2025-08-10 08:31:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 867.593834ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X...X....X.......X....X.............................X......] duration:
2.428092021s
FAIL (2025-08-10 08:31:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.428120101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..........X.....................X..........] duration:
840.682542ms
FAIL (2025-08-10 08:30:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 840.747147ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X...X....X.......X....X.............................X.....] duration:
2.509767075s
FAIL (2025-08-10 08:30:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.509962393s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X..........X.....................X.........] duration:
853.453956ms
FAIL (2025-08-10 08:29:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 853.485921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X..........X.....................X........] duration:
830.916636ms
FAIL (2025-08-10 08:29:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 830.93721ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X...X....X.......X....X.............................X....] duration:
2.398928842s
FAIL (2025-08-10 08:29:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.398961123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X..........X.....................X.......] duration:
826.575132ms
FAIL (2025-08-10 08:28:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 826.608343ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X...X....X.......X....X.............................X...] duration:
2.390019589s
FAIL (2025-08-10 08:28:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.390045927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........X.....................X......] duration:
824.634003ms
FAIL (2025-08-10 08:28:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 824.674705ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........X.....................X.....] duration:
838.340095ms
FAIL (2025-08-10 08:27:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:23:58.822393312 (38h58m20.781490547s) [upload=40634]: Starting upload
Aug 10 08:23:58.822453216 (38h58m20.781550453s) [upload=40634]: Done starting upload
Aug 10 08:23:58.822542981 (38h58m20.781640227s) [upload=40634]: Uploading segments...
Aug 10 08:23:58.822616012 (38h58m20.781713263s) [upload=40634]: Got next segment. Inline: true
Aug 10 08:23:58.822621737 (38h58m20.781718981s) [upload=40634]: Waiting for error group managing segments...
Aug 10 08:23:58.822679314 (38h58m20.781776559s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:23:58.822684276 (38h58m20.781781521s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:23:58.822687700 (38h58m20.781784946s) [upload=40634]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:23:59.262556240 (38h58m21.221653485s) [upload=40634]: Done uploading segments...
Aug 10 08:23:59.262576109 (38h58m21.221673355s) [upload=40634]: Upload finished. err: <nil>
Duration: 838.359703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X...X....X.......X....X.............................X..] duration:
2.33490539s
FAIL (2025-08-10 08:27:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.334940394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|