Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.............................X.....................] duration:
818.370776ms
FAIL (2025-08-10 11:37:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.41429ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........X........................X.........] duration:
2.411048212s
FAIL (2025-08-10 11:37:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.411072572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X.............................X....................] duration:
986.243876ms
FAIL (2025-08-10 11:36:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 986.301462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X..........X........................X........] duration:
2.338037847s
FAIL (2025-08-10 11:36:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.338073865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X.............................X...................] duration:
996.006102ms
FAIL (2025-08-10 11:35:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 996.036794ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X..........X........................X.......] duration:
2.485772228s
FAIL (2025-08-10 11:35:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.485872033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X..........X........................X......] duration:
2.823052642s
FAIL (2025-08-10 11:34:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.823082006s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X.............................X..................] duration:
818.235713ms
FAIL (2025-08-10 11:34:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.265446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X.............................X.................] duration:
852.080572ms
FAIL (2025-08-10 11:34:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.109419ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X..........X........................X.....] duration:
2.350287445s
FAIL (2025-08-10 11:34:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.35041917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X..........X........................X....] duration:
2.298795066s
FAIL (2025-08-10 11:33:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.298824661s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.............................X................] duration:
833.765814ms
FAIL (2025-08-10 11:33:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.791792ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.............................X...............] duration:
828.261101ms
FAIL (2025-08-10 11:32:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.293099ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.............................X..............] duration:
1.00474283s
FAIL (2025-08-10 11:32:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.004777738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........X........................X...] duration:
2.282324571s
FAIL (2025-08-10 11:32:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.28248967s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........X........................X..] duration:
2.647055749s
FAIL (2025-08-10 11:32:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.647086246s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.............................X.............] duration:
908.117785ms
FAIL (2025-08-10 11:31:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.145982ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X..........X........................X.] duration:
2.334962443s
FAIL (2025-08-10 11:31:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 2.33499776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.............................X............] duration:
804.942188ms
FAIL (2025-08-10 11:31:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 805.013358ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.............................X...........] duration:
859.22986ms
FAIL (2025-08-10 11:30:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.284846ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..........X........................X] duration:
1.637306974s
FAIL (2025-08-10 11:30:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 11:30:12.461643988 (42h4m34.42074122s) [upload=43848]: Starting upload
Aug 10 11:30:12.461686635 (42h4m34.420783868s) [upload=43848]: Done starting upload
Aug 10 11:30:12.461968404 (42h4m34.421065636s) [upload=43848]: Uploading segments...
Aug 10 11:30:12.462006313 (42h4m34.421103567s) [upload=43848]: Got next segment. Inline: false
Aug 10 11:30:12.462033163 (42h4m34.421130411s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:30:12.462037254 (42h4m34.421134498s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:30:12.656444617 (42h4m34.615541863s) [seg_pos={0 0}, upload=43848]: Begin upload segment...
Aug 10 11:30:12.656531192 (42h4m34.615628437s) [seg_pos={0 0}, upload=43848]: Done begin upload segment.
Aug 10 11:30:12.656544937 (42h4m34.615642207s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.656555269 (42h4m34.615652517s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657024848 (42h4m34.616122096s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657309486 (42h4m34.616406736s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657634197 (42h4m34.616731448s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.657901981 (42h4m34.616999212s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658253910 (42h4m34.617351158s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658455028 (42h4m34.617552282s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.658814084 (42h4m34.617911333s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659158600 (42h4m34.618255847s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659553146 (42h4m34.618650402s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.659902736 (42h4m34.618999993s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660213328 (42h4m34.619310572s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660495563 (42h4m34.619592807s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660684633 (42h4m34.619781889s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.660985266 (42h4m34.620082518s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661229220 (42h4m34.620326464s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:12.661338244 (42h4m34.620435498s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Uploading piece...
Aug 10 11:30:13.225590353 (42h4m35.184687585s) [upload=43848]: Next returned nil segment
Aug 10 11:30:13.225611440 (42h4m35.184708688s) [upload=43848]: Waiting for error group managing segments...
Aug 10 11:30:13.364788496 (42h4m35.323885735s) [noise=true , address=77.90.31.15:4719 , piece_id=LRBITZ46ZBRHJZFJI4NDTFB2JVYLN6DJLH7WH4PPZXMLP7R33P4A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.383713600 (42h4m35.342810838s) [noise=true , address=104.36.82.19:4427 , piece_id=BZ4CFTLQYVHQWT3UA6J37PIW5JCAMSLMEMCPULYPCRSXXE5T4GNA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.387030045 (42h4m35.346127283s) [noise=true , address=104.36.82.35:4609 , piece_id=3KTCED7C44NVUX7TH2F2ZXLMFABJ7QF2ZZCO5RC4SFC3N5YAFYGQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.388915251 (42h4m35.348012487s) [noise=true , address=45.91.116.13:4185 , piece_id=RKUTNVFJYCQSEZDKD2G7XVISQQSEAKBN22P5UO2BCM3NAZKETPXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.399533684 (42h4m35.358630922s) [noise=true , address=104.36.82.49:4985 , piece_id=M3NLDCZNFZYTRQGM6IFNX6BLLVYCJCZBRTVGIIUEHR4TPBVK6XZA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.410493747 (42h4m35.369590979s) [noise=true , address=104.36.82.59:4315 , piece_id=VKHMEPT6S4YDVQ5L4MLI5RUGIVIEJXXI4QB6AYWLPCPJIO7WP6LQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.416215931 (42h4m35.375313181s) [noise=true , address=104.36.82.44:4900 , piece_id=LEU4RRQJM6SR66SK66QFYZAK4PJ77QB2QEBVY2LQNI7QAWKMC27Q, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.419771607 (42h4m35.378868842s) [noise=true , address=104.36.82.60:4370 , piece_id=GGLTNASAMQV7GHAEX6J72PNYIOE3SJ4Y7RMHXKBTVSUBI6DXVEQA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.421331623 (42h4m35.380428855s) [noise=true , address=104.36.82.12:4164 , piece_id=QWIR3PGQKH5IIJACR4YVX3H3FDFJS5USQEDMIWW75IYVRJLTHCOA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.422342961 (42h4m35.381440209s) [noise=true , address=104.36.82.55:4207 , piece_id=YI5BN2WJ3T7XVDRHVZS2JEH2MGDZWWUFPLEE2XHLQDXQIDNGKWFA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424560072 (42h4m35.383657322s) [noise=true , address=104.36.82.16:4324 , piece_id=YNTZ4JY6SQ6GICB6NRWQT2XRMSJTC63ITCFLHUHJ7PSY3AH6XH6A, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.424581484 (42h4m35.383678722s) [noise=true , address=104.36.82.62:4440 , piece_id=LHB6R5WF6A5NQMTT2M6YORD535PL3CZ4DZGD6WK45DEZ4T7DRQJA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425397967 (42h4m35.384495206s) [noise=true , address=104.36.82.23:4463 , piece_id=CFA3FEMJUFEKQSRZBIM7EVXE4XEJ3N3WY2O6V6PCYDHHDXF5Q7NA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425985495 (42h4m35.385082734s) [noise=true , address=104.36.82.58:4291 , piece_id=CRTBWFRIDLUVSZBUW7QGBXEGJJD2NHI2B5TZU5WPA2JSA2ZICUYA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: <nil>
Aug 10 11:30:13.425996004 (42h4m35.385093242s) [seg_pos={0 0}, upload=43848]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:30:13.426129791 (42h4m35.385227037s) [noise=true , address=104.36.82.37:4672 , piece_id=35PVADXCCMMBCKMLUKHHWKHWV45KOY4IXTCU3HRX5N5TFYCDLTLQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426228410 (42h4m35.385325655s) [noise=true , address=104.36.82.36:4636 , piece_id=CDIBUVSWOPYGMIOS762B5XOXR7Z6AAGD3OOVQSBTCA3WI5IBFKTA, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Lx4f6jtUdcZd9mVy5DgWqZ2vd4SrpSviaT7WUedxs7PLyzfHZ): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426410728 (42h4m35.385507974s) [noise=true , address=104.36.82.14:4241 , piece_id=LYJHQDM5ARBWCN76GT3CFKUJ2NE3VIDSVJZVVGCWPRMQCF5QKPBQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 10 11:30:13.426536107 (42h4m35.385633352s) [noise=true , address=64.49.13.170:4725 , piece_id=YDOJAQAWZHSMZQJVXCULFJE3VDCHO4WFWNIM6HKVWAORATQ2KVXQ, seg_pos={0 0}, upload=43848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35484->64.49.13.170:4725: use of closed network connection
Aug 10 11:30:13.426549175 (42h4m35.385646411s) [seg_pos={0 0}, upload=43848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:30:13.426624552 (42h4m35.385721797s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:30:13.426629080 (42h4m35.385726328s) [upload=43848]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:30:13.575036998 (42h4m35.534134244s) [upload=43848]: Done uploading segments...
Aug 10 11:30:13.575059494 (42h4m35.534156731s) [upload=43848]: Upload finished. err: <nil>
Duration: 1.637331962s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..........X........................] duration:
2.31615851s
FAIL (2025-08-10 11:29:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.316188929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.............................X..........] duration:
812.090928ms
FAIL (2025-08-10 11:29:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 812.115674ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..........X.......................] duration:
2.408838392s
FAIL (2025-08-10 11:28:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.408866064s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.............................X.........] duration:
834.671047ms
FAIL (2025-08-10 11:28:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.697172ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..........X......................] duration:
2.288597424s
FAIL (2025-08-10 11:27:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.288628685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.............................X........] duration:
827.625772ms
FAIL (2025-08-10 11:27:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.655867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..........X.....................] duration:
2.345595505s
FAIL (2025-08-10 11:27:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.345624627s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............................X.......] duration:
838.578909ms
FAIL (2025-08-10 11:26:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.687044ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..........X....................] duration:
2.32636888s
FAIL (2025-08-10 11:26:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.326419638s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............................X......] duration:
830.034636ms
FAIL (2025-08-10 11:26:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.063437ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............................X.....] duration:
838.51968ms
FAIL (2025-08-10 11:25:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.567214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X..........X...................] duration:
2.445789301s
FAIL (2025-08-10 11:25:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.445827659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............................X....] duration:
821.27561ms
FAIL (2025-08-10 11:24:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.311193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X..........X..................] duration:
2.365704933s
FAIL (2025-08-10 11:24:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.365749353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............................X...] duration:
810.515192ms
FAIL (2025-08-10 11:23:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 810.546835ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X..........X.................] duration:
2.386516746s
FAIL (2025-08-10 11:23:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.386546392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............................X..] duration:
814.875606ms
FAIL (2025-08-10 11:23:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 814.915392ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X..........X................] duration:
2.459699964s
FAIL (2025-08-10 11:22:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.459761879s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............................X.] duration:
849.304096ms
FAIL (2025-08-10 11:22:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.333317ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X..........X...............] duration:
2.360674424s
FAIL (2025-08-10 11:22:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.360718349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............................X] duration:
364.956418ms
FAIL (2025-08-10 11:21:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:21:52.047917488 (41h56m14.007014736s) [upload=43695]: Starting upload Aug 10 11:21:52.047961375 (41h56m14.007058629s) [upload=43695]: Done starting upload Aug 10 11:21:52.048038467 (41h56m14.0071357s) [upload=43695]: Uploading segments... Aug 10 11:21:52.048102680 (41h56m14.007199935s) [upload=43695]: Got next segment. Inline: true Aug 10 11:21:52.048107908 (41h56m14.007205153s) [upload=43695]: Waiting for error group managing segments... Aug 10 11:21:52.048156913 (41h56m14.007254146s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:21:52.048161108 (41h56m14.007258352s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:21:52.048164114 (41h56m14.007261359s) [upload=43695]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:21:52.138730106 (41h56m14.097827351s) [upload=43695]: Done uploading segments... Aug 10 11:21:52.138749041 (41h56m14.097846287s) [upload=43695]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.981148ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X..........X..............] duration:
2.373071703s
FAIL (2025-08-10 11:21:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.373100217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X..........X.............] duration:
2.468842586s
FAIL (2025-08-10 11:21:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.468902867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X..........X............] duration:
2.33302002s
FAIL (2025-08-10 11:20:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.333056907s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
831.462068ms
FAIL (2025-08-10 11:20:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 975a36400be1728e7c6d5a07857c7ace9147231dc711c2f47b5d69b1ba44bd9f != before fbcb44c30ec3642a824f83d11b89db0e3272fb66f5cde1056fb29a609b2200c9 ======LOGS====== Aug 10 10:58:03.774690774 (41h32m25.733788013s) [upload=43296]: Starting upload Aug 10 10:58:03.774760512 (41h32m25.733857757s) [upload=43296]: Done starting upload Aug 10 10:58:03.774852826 (41h32m25.733950073s) [upload=43296]: Uploading segments... Aug 10 10:58:03.774905994 (41h32m25.734003248s) [upload=43296]: Got next segment. Inline: true Aug 10 10:58:03.774911696 (41h32m25.734008944s) [upload=43296]: Waiting for error group managing segments... Aug 10 10:58:03.774984464 (41h32m25.734081699s) [upload=43296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:58:03.774990556 (41h32m25.734087805s) [upload=43296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 10:58:03.774995485 (41h32m25.734092734s) [upload=43296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 10:58:03.930486521 (41h32m25.88958376s) [upload=43296]: Done uploading segments... Aug 10 10:58:03.930508886 (41h32m25.889606125s) [upload=43296]: Upload finished. err: <nil>
Duration: 831.486246ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration:
2.35649861s
FAIL (2025-08-10 11:20:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.356555572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
833.948783ms
FAIL (2025-08-10 11:19:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 975a36400be1728e7c6d5a07857c7ace9147231dc711c2f47b5d69b1ba44bd9f != before fbcb44c30ec3642a824f83d11b89db0e3272fb66f5cde1056fb29a609b2200c9 ======LOGS====== Aug 10 10:58:03.774690774 (41h32m25.733788013s) [upload=43296]: Starting upload Aug 10 10:58:03.774760512 (41h32m25.733857757s) [upload=43296]: Done starting upload Aug 10 10:58:03.774852826 (41h32m25.733950073s) [upload=43296]: Uploading segments... Aug 10 10:58:03.774905994 (41h32m25.734003248s) [upload=43296]: Got next segment. Inline: true Aug 10 10:58:03.774911696 (41h32m25.734008944s) [upload=43296]: Waiting for error group managing segments... Aug 10 10:58:03.774984464 (41h32m25.734081699s) [upload=43296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:58:03.774990556 (41h32m25.734087805s) [upload=43296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 10:58:03.774995485 (41h32m25.734092734s) [upload=43296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 10:58:03.930486521 (41h32m25.88958376s) [upload=43296]: Done uploading segments... Aug 10 10:58:03.930508886 (41h32m25.889606125s) [upload=43296]: Upload finished. err: <nil>
Duration: 833.981817ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration:
2.348353937s
FAIL (2025-08-10 11:19:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.348402618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration:
2.339092598s
FAIL (2025-08-10 11:18:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:11:16.283619266 (41h45m38.242716501s) [upload=43520]: Starting upload Aug 10 11:11:16.283676869 (41h45m38.242774114s) [upload=43520]: Done starting upload Aug 10 11:11:16.283818568 (41h45m38.242915805s) [upload=43520]: Uploading segments... Aug 10 11:11:16.284082821 (41h45m38.243180066s) [upload=43520]: Got next segment. Inline: false Aug 10 11:11:16.284113504 (41h45m38.243210749s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:11:16.284118812 (41h45m38.243216057s) [upload=43520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:11:16.372985105 (41h45m38.332082358s) [upload=43520]: Next segment err: metaclient: Too Many Requests Aug 10 11:11:16.373023442 (41h45m38.332120687s) [upload=43520]: Done uploading segments... Aug 10 11:11:16.373041974 (41h45m38.332139213s) [upload=43520]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.339126692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|