Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration:
1.077984558s
FAIL (2025-08-13 23:10:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.078034983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.664553661s
FAIL (2025-08-13 23:09:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.664595395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration:
1.234788676s
FAIL (2025-08-13 23:09:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.234827401s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.924261278s
FAIL (2025-08-13 23:08:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.92431252s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration:
1.420807524s
FAIL (2025-08-13 23:08:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.420863223s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.683084397s
FAIL (2025-08-13 23:07:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.683127864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.605060828s
FAIL (2025-08-13 23:07:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.605096136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X..........X........] duration:
1.159147223s
FAIL (2025-08-13 23:07:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.159172225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..........X.......] duration:
1.433014772s
FAIL (2025-08-13 23:06:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.433046695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
3.289169407s
FAIL (2025-08-13 23:06:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 3.289200746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..........X......] duration:
1.026017425s
FAIL (2025-08-13 23:05:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.026057321s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..........X.....] duration:
869.794196ms
FAIL (2025-08-13 23:05:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 869.829123ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.483226041s
FAIL (2025-08-13 23:05:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.483340738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X..........X....] duration:
1.090445103s
FAIL (2025-08-13 23:05:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.090543937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.....................X.....................................] duration:
3.047070142s
FAIL (2025-08-13 23:04:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 3.047230623s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X..........X...] duration:
1.11568689s
FAIL (2025-08-13 23:03:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.11571075s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................X....................................] duration:
2.61572935s
FAIL (2025-08-13 23:03:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.615762063s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................X...................................] duration:
2.994899386s
FAIL (2025-08-13 23:03:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.994932206s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X..........X..] duration:
1.213662906s
FAIL (2025-08-13 23:03:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.213716986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................X..................................] duration:
2.459348292s
FAIL (2025-08-13 23:02:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.459391002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X..........X.] duration:
1.263127985s
FAIL (2025-08-13 23:02:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 1.263173647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X..........X] duration:
820.546365ms
FAIL (2025-08-13 23:01:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 23:01:32.571975608 (125h35m54.531072853s) [upload=130845]: Starting upload
Aug 13 23:01:32.572038698 (125h35m54.531135947s) [upload=130845]: Done starting upload
Aug 13 23:01:32.572112791 (125h35m54.53121003s) [upload=130845]: Uploading segments...
Aug 13 23:01:32.572189434 (125h35m54.531286682s) [upload=130845]: Got next segment. Inline: true
Aug 13 23:01:32.572195316 (125h35m54.531292561s) [upload=130845]: Waiting for error group managing segments...
Aug 13 23:01:32.572248566 (125h35m54.531345801s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 23:01:32.572253257 (125h35m54.531350492s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 23:01:32.572256786 (125h35m54.531354031s) [upload=130845]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 23:01:32.791978274 (125h35m54.751075517s) [upload=130845]: Done uploading segments...
Aug 13 23:01:32.792000312 (125h35m54.751097547s) [upload=130845]: Upload finished. err: <nil>
Duration: 820.577315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................X.................................] duration:
2.744112302s
FAIL (2025-08-13 23:01:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.744147211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.215238424s
FAIL (2025-08-13 23:01:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.215363154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.317377185s
FAIL (2025-08-13 23:00:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.317409533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.159247923s
FAIL (2025-08-13 23:00:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.159283204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................X................................] duration:
2.565735622s
FAIL (2025-08-13 23:00:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.565773366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.048807869s
FAIL (2025-08-13 22:59:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.048923552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................X...............................] duration:
2.475305091s
FAIL (2025-08-13 22:59:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.475358725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.109741227s
FAIL (2025-08-13 22:59:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.109782141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................X..............................] duration:
3.178804731s
FAIL (2025-08-13 22:58:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 3.178837596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.06447942s
FAIL (2025-08-13 22:58:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.064533227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.....................X.............................] duration:
3.247456788s
FAIL (2025-08-13 22:58:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 3.247502135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.057066625s
FAIL (2025-08-13 22:57:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.057092286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.....................X............................] duration:
2.658851103s
FAIL (2025-08-13 22:57:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.658881294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.....................X...........................] duration:
2.434088447s
FAIL (2025-08-13 22:56:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.434133933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.321420133s
FAIL (2025-08-13 22:56:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.321470802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
896.183063ms
FAIL (2025-08-13 22:56:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 896.211094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.....................X..........................] duration:
2.627938731s
FAIL (2025-08-13 22:55:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.627966211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
854.633486ms
FAIL (2025-08-13 22:55:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.686111ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
375.015621ms
FAIL (2025-08-13 22:54:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:54:49.864644557 (125h29m11.823741795s) [upload=130732]: Starting upload Aug 13 22:54:49.864699293 (125h29m11.82379653s) [upload=130732]: Done starting upload Aug 13 22:54:49.864756613 (125h29m11.82385385s) [upload=130732]: Uploading segments... Aug 13 22:54:49.864800039 (125h29m11.823897293s) [upload=130732]: Got next segment. Inline: true Aug 13 22:54:49.864805383 (125h29m11.823902628s) [upload=130732]: Waiting for error group managing segments... Aug 13 22:54:49.864848267 (125h29m11.823945502s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:54:49.864853784 (125h29m11.82395103s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:54:49.864857310 (125h29m11.823954555s) [upload=130732]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:54:49.955446881 (125h29m11.914544126s) [upload=130732]: Done uploading segments... Aug 13 22:54:49.955465983 (125h29m11.914563215s) [upload=130732]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.039949ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.....................X.........................] duration:
2.697919362s
FAIL (2025-08-13 22:54:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.697953724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.....................X........................] duration:
3.135673258s
FAIL (2025-08-13 22:53:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 3.135703558s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.....................X.......................] duration:
2.78328629s
FAIL (2025-08-13 22:53:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.783322449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.....................X......................] duration:
2.736852062s
FAIL (2025-08-13 22:52:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.736888678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.....................X.....................] duration:
2.697025786s
FAIL (2025-08-13 22:51:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.697066746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.....................X....................] duration:
2.524285783s
FAIL (2025-08-13 22:50:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.524325105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.....................X...................] duration:
2.932576327s
FAIL (2025-08-13 22:49:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.932621664s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.....................X..................] duration:
3.261892085s
FAIL (2025-08-13 22:48:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 3.261929198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.....................X.................] duration:
2.587806172s
FAIL (2025-08-13 22:48:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:35:57.537693080 (125h10m19.496790336s) [upload=130394]: Starting upload
Aug 13 22:35:57.537770422 (125h10m19.496867692s) [upload=130394]: Done starting upload
Aug 13 22:35:57.537860469 (125h10m19.496957702s) [upload=130394]: Uploading segments...
Aug 13 22:35:57.538222973 (125h10m19.497320227s) [upload=130394]: Got next segment. Inline: false
Aug 13 22:35:57.538789817 (125h10m19.497887072s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:35:57.538802647 (125h10m19.497899897s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:35:57.769525590 (125h10m19.728622855s) [seg_pos={0 0}, upload=130394]: Begin upload segment...
Aug 13 22:35:57.769597702 (125h10m19.728694948s) [seg_pos={0 0}, upload=130394]: Done begin upload segment.
Aug 13 22:35:57.769626513 (125h10m19.728723761s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.769666998 (125h10m19.728764266s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770189124 (125h10m19.729286378s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770203935 (125h10m19.72930118s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770505036 (125h10m19.729602283s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770602178 (125h10m19.729699423s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.770793103 (125h10m19.729890353s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771190169 (125h10m19.730287421s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771199827 (125h10m19.730297078s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771495889 (125h10m19.73059314s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771584536 (125h10m19.730681782s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771786781 (125h10m19.730884032s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.771909428 (125h10m19.731006673s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772068643 (125h10m19.731165891s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772252681 (125h10m19.731349926s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772351677 (125h10m19.731448932s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.772582692 (125h10m19.731679938s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:57.775822064 (125h10m19.734919299s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Uploading piece...
Aug 13 22:35:58.333038491 (125h10m20.292135737s) [upload=130394]: Next returned nil segment
Aug 13 22:35:58.333055409 (125h10m20.292152655s) [upload=130394]: Waiting for error group managing segments...
Aug 13 22:35:58.507975862 (125h10m20.467073094s) [noise=true , address=77.90.31.12:4601 , piece_id=UYZ5CG4FCIQ4LT4AF5JZMGNL2JXXF2YBWH3MRMQOOCHZT3IMDUWQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.522606363 (125h10m20.481703602s) [noise=true , address=104.36.82.23:4448 , piece_id=MHLE72XJGYVRSISXC2VNWJV5L7ENSSQREVKNIEI7TSXNYMDSBN3A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.541177655 (125h10m20.500274889s) [noise=true , address=104.36.82.23:4476 , piece_id=RYOWRL7Z2BWX3DSNIBGKW2HN6MAMCZ5XDF7XVPG3KG72SBCBEHBQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.560588111 (125h10m20.519685359s) [noise=true , address=77.90.31.16:4741 , piece_id=ZPZM3OCK6NQHI7L3LLQPJAAAQ46L3RXIO47IA4U6OGFTNI7KPHHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.562189685 (125h10m20.521286921s) [noise=true , address=104.36.82.44:4899 , piece_id=EMRA7ZMSBGLEFUWO5GX4ECXOT3RTPGOSIWCNRH76HYQM2CIS4M4A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.564359033 (125h10m20.523456271s) [noise=true , address=104.36.82.15:4271 , piece_id=TB6JRECOSCMQ4B6TM5L7PEZKKZVWCMAISTRHPC44RJBE7OQ4QWDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.570326070 (125h10m20.529423315s) [noise=true , address=104.36.82.4:4830 , piece_id=XYCI2PWIF436F5YK2E7DRL5J7TGWL3KVX57IUE36GKCJRK5UKQ2A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.622710074 (125h10m20.581807319s) [noise=true , address=104.36.82.62:4416 , piece_id=DD2JFJFHN5SRP3JO374H4HG2D3C6R4FVF7FAYCZAUVLMS5EUBBLA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.628035256 (125h10m20.587132501s) [noise=true , address=104.36.82.8:4988 , piece_id=2QUAU24AEMLQFTZRNT7U4H7OHNC65HQYLT6LFCDHQPFVFGEQ7CPQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.663217239 (125h10m20.622314477s) [noise=true , address=104.36.82.37:4669 , piece_id=OZHZLIX6ZKQRT7KQHWS4BH7RA7DHVF52AGRDFVYX4AIYGVXEH7CQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.687456588 (125h10m20.646553819s) [noise=true , address=104.36.82.58:4291 , piece_id=JX77DE7AVAU5EQR7DIAJJDII4YCGRRVARVEUHCXEV76WABWX2V7A, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.786600049 (125h10m20.745697295s) [noise=true , address=104.36.82.61:4383 , piece_id=4HTZTOM2D6NDYQFHTCVJTHFA45ETKZE4BTK3FSDZLSGAYG4LNJDQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.827788369 (125h10m20.786885614s) [noise=true , address=104.36.82.47:4529 , piece_id=KRJYG3ANKPHE7XKITTS26KXLA4ZR5NQSV5COXKOLXWEYM4LN6GIQ, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951802857 (125h10m20.910900102s) [noise=true , address=104.36.82.36:4630 , piece_id=XFO5EWKNOU2EJV4NBOZYGGHNVRAT2VA7MEE26F5IRXRGUB2YVFZA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: <nil>
Aug 13 22:35:58.951833404 (125h10m20.910930651s) [seg_pos={0 0}, upload=130394]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:35:58.952024603 (125h10m20.911121835s) [noise=true , address=64.49.13.26:4950 , piece_id=MDQCLT7EB3EVDCC2OMIH3PCM3EQY7VBCGG26VYPVRITYW4STFUFA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952073423 (125h10m20.911170659s) [noise=true , address=64.49.13.137:4493 , piece_id=B3DW5MUOKWK2IJMP27OXJSWTAQZZQO7HBWWJXY2QZJBRZEUCK4BA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952109219 (125h10m20.911206451s) [noise=true , address=104.36.82.5:4848 , piece_id=VLSRAYGEXDIDVZZ2IUU5ZK2IBMHAAWB5LP25UCVTSNX5S7T5WVYA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48604->104.36.82.5:4848: use of closed network connection
Aug 13 22:35:58.952157310 (125h10m20.911254555s) [noise=true , address=104.36.82.59:4313 , piece_id=4GO2XHITN3ZEV2ZGEZ6LFT55VCOHSQNL2OFO2D4D65J7I4DNENHA, seg_pos={0 0}, upload=130394]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129PGPQsUffpwc81NKDdgn5VoYZGmhkBoQpGmDbTpNJsQbfhTvw): protocol: expected piece hash; context canceled; EOF
Aug 13 22:35:58.952172914 (125h10m20.911270159s) [seg_pos={0 0}, upload=130394]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:35:58.952264592 (125h10m20.91136184s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:35:58.952270637 (125h10m20.911367884s) [upload=130394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:35:59.161731864 (125h10m21.120829099s) [upload=130394]: Done uploading segments...
Aug 13 22:35:59.161755504 (125h10m21.120852751s) [upload=130394]: Upload finished. err: <nil>
Duration: 2.587864675s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|