Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X....................X.....................X.............] duration:
924.01542ms
FAIL (2025-08-10 09:05:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 924.044511ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.31798108s
FAIL (2025-08-10 09:05:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.318057921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X....................X.....................X............] duration:
862.579422ms
FAIL (2025-08-10 09:05:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 862.605069ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.311015065s
FAIL (2025-08-10 09:05:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.31105145s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.273956227s
FAIL (2025-08-10 09:04:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.273990677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X....................X.....................X...........] duration:
839.239048ms
FAIL (2025-08-10 09:04:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 839.266663ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.420838092s
FAIL (2025-08-10 09:04:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.420870835s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X....................X.....................X..........] duration:
872.848709ms
FAIL (2025-08-10 09:03:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 872.879537ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.481688617s
FAIL (2025-08-10 09:03:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.481720819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.29214215s
FAIL (2025-08-10 09:02:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.292170907s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X....................X.....................X.........] duration:
827.095542ms
FAIL (2025-08-10 09:02:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 827.124012ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X....................X.....................X........] duration:
877.576915ms
FAIL (2025-08-10 09:02:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 877.609442ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.225007727s
FAIL (2025-08-10 09:02:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.225036034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X....................X.....................X.......] duration:
827.068967ms
FAIL (2025-08-10 09:01:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 827.103973ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X....................X.....................X......] duration:
929.670589ms
FAIL (2025-08-10 09:01:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 929.695053ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.289806622s
FAIL (2025-08-10 09:01:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.289836453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X....................X.....................X.....] duration:
836.875044ms
FAIL (2025-08-10 09:00:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 836.926421ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.310976874s
FAIL (2025-08-10 09:00:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.311010545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X....................X.....................X....] duration:
842.198151ms
FAIL (2025-08-10 08:59:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 842.294631ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.313720956s
FAIL (2025-08-10 08:59:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.31381974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X....................X.....................X...] duration:
846.929738ms
FAIL (2025-08-10 08:58:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 846.958162ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.327829544s
FAIL (2025-08-10 08:57:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.32785979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X....................X.....................X..] duration:
821.437479ms
FAIL (2025-08-10 08:57:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 821.464566ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.31924408s
FAIL (2025-08-10 08:57:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.319278495s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X....................X.....................X.] duration:
835.321031ms
FAIL (2025-08-10 08:57:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 835.352707ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.362388851s
FAIL (2025-08-10 08:56:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.362412848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X....................X.....................X] duration:
704.656493ms
FAIL (2025-08-10 08:56:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 08:56:03.676281637 (39h30m25.635378873s) [upload=41174]: Starting upload
Aug 10 08:56:03.676363730 (39h30m25.635460976s) [upload=41174]: Done starting upload
Aug 10 08:56:03.676437961 (39h30m25.635535207s) [upload=41174]: Uploading segments...
Aug 10 08:56:03.676492103 (39h30m25.635589357s) [upload=41174]: Got next segment. Inline: true
Aug 10 08:56:03.676497586 (39h30m25.635594833s) [upload=41174]: Waiting for error group managing segments...
Aug 10 08:56:03.676543155 (39h30m25.6356404s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:56:03.676548212 (39h30m25.635645451s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 08:56:03.676551705 (39h30m25.635648951s) [upload=41174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:56:03.819120625 (39h30m25.778217874s) [upload=41174]: Done uploading segments...
Aug 10 08:56:03.819166695 (39h30m25.77826393s) [upload=41174]: Upload finished. err: <nil>
Duration: 704.685895ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X....................X.....................] duration:
837.202829ms
FAIL (2025-08-10 08:55:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.250399ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.340636706s
FAIL (2025-08-10 08:55:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.340676019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X....................X....................] duration:
988.929845ms
FAIL (2025-08-10 08:54:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 988.99914ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.495368711s
FAIL (2025-08-10 08:54:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.495461526s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X....................X...................] duration:
818.958069ms
FAIL (2025-08-10 08:53:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.997971ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.338363168s
FAIL (2025-08-10 08:53:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.338394756s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.443697663s
FAIL (2025-08-10 08:52:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.443728508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X....................X..................] duration:
859.263687ms
FAIL (2025-08-10 08:52:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.296927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.319151314s
FAIL (2025-08-10 08:51:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.31919042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....................X.................] duration:
836.139814ms
FAIL (2025-08-10 08:51:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.169462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.280434325s
FAIL (2025-08-10 08:50:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.280475016s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.....................X....................X................] duration:
1.180368775s
FAIL (2025-08-10 08:50:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.180398792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.....................X....................X...............] duration:
1.212611667s
FAIL (2025-08-10 08:49:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.212640622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.739368403s
FAIL (2025-08-10 08:49:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.739400634s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.............................X.............................] duration:
10.690276459s
FAIL (2025-08-10 08:49:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 10.690305101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.....................X....................X..............] duration:
3.118725509s
FAIL (2025-08-10 08:49:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.118752276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.............................X............................] duration:
2.248662157s
FAIL (2025-08-10 08:48:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.248698404s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.....................X....................X.............] duration:
827.12691ms
FAIL (2025-08-10 08:48:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.215001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.....................X....................X............] duration:
869.053265ms
FAIL (2025-08-10 08:47:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.07759ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.............................X...........................] duration:
2.374111629s
FAIL (2025-08-10 08:47:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.374140781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.............................X..........................] duration:
2.265552131s
FAIL (2025-08-10 08:46:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 08:26:22.704425546 (39h0m44.663522804s) [upload=40670]: Starting upload
Aug 10 08:26:22.704559802 (39h0m44.663657051s) [upload=40670]: Done starting upload
Aug 10 08:26:22.704656468 (39h0m44.663753722s) [upload=40670]: Uploading segments...
Aug 10 08:26:22.704959861 (39h0m44.664057114s) [upload=40670]: Got next segment. Inline: false
Aug 10 08:26:22.705043048 (39h0m44.664140304s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 08:26:22.705050350 (39h0m44.664147598s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 08:26:22.902048566 (39h0m44.861145814s) [seg_pos={0 0}, upload=40670]: Begin upload segment...
Aug 10 08:26:22.902112552 (39h0m44.861209784s) [seg_pos={0 0}, upload=40670]: Done begin upload segment.
Aug 10 08:26:22.902148365 (39h0m44.861245619s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902156930 (39h0m44.861254176s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902588377 (39h0m44.861685623s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902608532 (39h0m44.861705779s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.902866500 (39h0m44.861963751s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903016614 (39h0m44.862113863s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903170205 (39h0m44.86226746s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903355124 (39h0m44.862452375s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903465466 (39h0m44.862562702s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.903640078 (39h0m44.862737323s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906028048 (39h0m44.865125318s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.906433706 (39h0m44.865530957s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907642294 (39h0m44.866739548s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.907701551 (39h0m44.866798816s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908135880 (39h0m44.86723313s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.908612883 (39h0m44.867710137s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909078172 (39h0m44.868175427s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:22.909447875 (39h0m44.868545125s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Uploading piece...
Aug 10 08:26:23.474624147 (39h0m45.433721378s) [upload=40670]: Next returned nil segment
Aug 10 08:26:23.474645555 (39h0m45.4337428s) [upload=40670]: Waiting for error group managing segments...
Aug 10 08:26:23.628091842 (39h0m45.587189075s) [noise=true , address=104.36.82.36:4622 , piece_id=VEXRXWKLYDEQW5MBS27PUTTPZTR77SWZEOU7TKW74BN5DO3F5DXQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.628942160 (39h0m45.588039406s) [noise=true , address=104.36.82.43:4833 , piece_id=TNZAXP3WGRWKVGN5GKD6ZDAQODND6ENP5OSKJGA3M2RW2Z7UBKTA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.629449975 (39h0m45.588547213s) [noise=true , address=104.36.82.37:4683 , piece_id=JOLIFLVNRV2HTYIX5TEFL5TPEVUUORZVWIYWXNEKPW4KMYTPASXA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.630968931 (39h0m45.590066182s) [noise=true , address=104.36.82.44:4870 , piece_id=BMPA4JHM4Y2FVTCUAFAXONCMFCXW4ZQOIBFEQPW53WCDIDJGKBFQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.631609506 (39h0m45.590706738s) [noise=true , address=104.36.82.50:4040 , piece_id=LSES4DLVLLZCS4YYF2SLSOOI2DDDXLA2NXG5B6CKKLG2AUWED6EA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.634057151 (39h0m45.59315439s) [noise=true , address=104.36.82.45:4938 , piece_id=IO42GIXP3DO6SW6HZBYIHFSDFQVT5UQJ26ZYZWBTBWYKTXU26RSQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.635328741 (39h0m45.594425987s) [noise=true , address=104.36.82.58:4277 , piece_id=SW45H7LZGXFE4GNF3DI5PHLIGYVZYO2VCDQGRS5O6KO6PB2OWEKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.638018542 (39h0m45.597115779s) [noise=true , address=104.36.82.19:4414 , piece_id=GKNRA2Q55NWOWDC6MBZLVNKYOEN35S2L4SUELQZY6VITMXZ5PQJA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.644725942 (39h0m45.603823181s) [noise=true , address=104.36.82.22:4532 , piece_id=A32TQ46TIGNT6NFH5D54QJWOOT6EAUQ4RAISNN6DPMI6NH5GQU7A, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646406415 (39h0m45.60550366s) [noise=true , address=104.36.82.9:4039 , piece_id=QLF5ON273SY3ROKJGQE2K37GMVTFBSGPVMSSIXUYLG3AO6PJLZRQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.646785635 (39h0m45.605882867s) [noise=true , address=104.36.82.62:4426 , piece_id=JD3ANUDXPPGYAGT24FDSEAOND64FXB3CKNR5J2E33HTRQRROXWQQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.650334018 (39h0m45.60943125s) [noise=true , address=104.36.82.5:4856 , piece_id=SD57DMVYT3IA65ZJ2WJ6HAZTJA46TSAIWXI23RACC7A4W7MDQK7Q, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.651278591 (39h0m45.610375828s) [noise=true , address=104.36.82.46:4513 , piece_id=UPJOQOXPGP6ZQWFDXXB72DF4K2Q2OZ3RIXASOKOKXGJA76HINSKQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661012096 (39h0m45.620109341s) [noise=true , address=104.36.82.18:4372 , piece_id=3GYTALPMWPYQ7HRXTF5ROO4DBHWVUYBM6KPKHHOXDGC5YLUZA5OQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: <nil>
Aug 10 08:26:23.661047577 (39h0m45.620144823s) [seg_pos={0 0}, upload=40670]: Segment reached optimal threshold of 14 pieces.
Aug 10 08:26:23.661375744 (39h0m45.62047298s) [noise=true , address=104.36.82.59:4329 , piece_id=CSX3UV5QSF3I6LFB2BGUAWCEUZVN7GPMKPKQ2HGVYV6NQQFREPOQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 10 08:26:23.661404171 (39h0m45.620501416s) [noise=true , address=64.49.13.140:4511 , piece_id=V755X2CUGEIEFCVX4F3DMMROZOOEDKWCFFTT3CVNIMWNIHIY2JRA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57868->64.49.13.140:4511: use of closed network connection
Aug 10 08:26:23.661470593 (39h0m45.620567828s) [noise=true , address=64.49.13.139:4478 , piece_id=2GCEWH26IHQTZZXRDEEQIPJNW5YB72CDCJXNJFH4WF2QHOL2FVWA, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48004->64.49.13.139:4478: use of closed network connection
Aug 10 08:26:23.661534770 (39h0m45.620632017s) [noise=true , address=64.49.13.170:4725 , piece_id=TKMJTZD2PPAOJAVIDXLLHMJGUWNF27R3V2FR26WTGTK72TOIHKTQ, seg_pos={0 0}, upload=40670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56194->64.49.13.170:4725: use of closed network connection
Aug 10 08:26:23.661579247 (39h0m45.620676498s) [seg_pos={0 0}, upload=40670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 08:26:23.661682635 (39h0m45.620779881s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 08:26:23.661688299 (39h0m45.620785544s) [upload=40670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 08:26:23.811647875 (39h0m45.770745109s) [upload=40670]: Done uploading segments...
Aug 10 08:26:23.811699288 (39h0m45.770796536s) [upload=40670]: Upload finished. err: <nil>
Duration: 2.265597355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.....................X....................X...........] duration:
830.086411ms
FAIL (2025-08-10 08:46:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.160836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.....................X....................X..........] duration:
897.828882ms
FAIL (2025-08-10 08:46:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 08:39:09.446557354 (39h13m31.4056546s) [upload=40890]: Starting upload Aug 10 08:39:09.446612006 (39h13m31.405709251s) [upload=40890]: Done starting upload Aug 10 08:39:09.446688330 (39h13m31.405785582s) [upload=40890]: Uploading segments... Aug 10 08:39:09.446776969 (39h13m31.405874223s) [upload=40890]: Got next segment. Inline: true Aug 10 08:39:09.446784181 (39h13m31.405881431s) [upload=40890]: Waiting for error group managing segments... Aug 10 08:39:09.446863781 (39h13m31.405961033s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 08:39:09.446872466 (39h13m31.405969718s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 08:39:09.446894636 (39h13m31.405991883s) [upload=40890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 08:39:09.534275470 (39h13m31.493372715s) [upload=40890]: Done uploading segments... Aug 10 08:39:09.534294768 (39h13m31.493392s) [upload=40890]: Upload finished. err: metaclient: Too Many Requests
Duration: 897.863633ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|