Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X................X.XX.........X.............] duration:
2.664874993s
FAIL (2025-08-13 02:11:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.664979029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X......................X.............X.........] duration:
1.15997235s
FAIL (2025-08-13 02:11:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.160008267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X................X.XX.........X............] duration:
2.551617329s
FAIL (2025-08-13 02:10:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.551653378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X......................X.............X........] duration:
874.867001ms
FAIL (2025-08-13 02:10:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.902351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X................X.XX.........X...........] duration:
2.39082535s
FAIL (2025-08-13 02:10:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.390859158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X................X.XX.........X..........] duration:
2.684488858s
FAIL (2025-08-13 02:09:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.684521409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X......................X.............X.......] duration:
1.028970028s
FAIL (2025-08-13 02:09:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.02905029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X................X.XX.........X.........] duration:
4.015180036s
FAIL (2025-08-13 02:08:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 4.015220685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X......................X.............X......] duration:
989.581201ms
FAIL (2025-08-13 02:08:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 989.616642ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X................X.XX.........X........] duration:
2.458467819s
FAIL (2025-08-13 02:08:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.458504117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X......................X.............X.....] duration:
852.453053ms
FAIL (2025-08-13 02:08:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.491606ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X................X.XX.........X.......] duration:
2.376922042s
FAIL (2025-08-13 02:08:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.377102056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X......................X.............X....] duration:
884.185644ms
FAIL (2025-08-13 02:07:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.212302ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X................X.XX.........X......] duration:
2.587165428s
FAIL (2025-08-13 02:07:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.587200366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X......................X.............X...] duration:
879.910189ms
FAIL (2025-08-13 02:06:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.9501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........................X................X.XX.........X.....] duration:
2.473929071s
FAIL (2025-08-13 02:06:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.473964814s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........................X................X.XX.........X....] duration:
2.628490316s
FAIL (2025-08-13 02:05:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.628558151s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........................X................X.XX.........X...] duration:
2.494805831s
FAIL (2025-08-13 02:05:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.494841691s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X......................X.............X..] duration:
845.547526ms
FAIL (2025-08-13 02:05:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.584869ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X......................X.............X.] duration:
892.189089ms
FAIL (2025-08-13 02:05:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.233963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........................X................X.XX.........X..] duration:
2.327416896s
FAIL (2025-08-13 02:05:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.327450038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............................X................X.XX.........X.] duration:
2.447716919s
FAIL (2025-08-13 02:04:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 2.447746115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X......................X.............X] duration:
360.360693ms
FAIL (2025-08-13 02:04:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:04:32.373796525 (104h38m54.332893773s) [upload=109052]: Starting upload Aug 13 02:04:32.373894713 (104h38m54.332991944s) [upload=109052]: Done starting upload Aug 13 02:04:32.374077221 (104h38m54.333174454s) [upload=109052]: Uploading segments... Aug 13 02:04:32.374233533 (104h38m54.33333079s) [upload=109052]: Got next segment. Inline: true Aug 13 02:04:32.374241789 (104h38m54.333339025s) [upload=109052]: Waiting for error group managing segments... Aug 13 02:04:32.374313875 (104h38m54.333411111s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:04:32.374321590 (104h38m54.333418839s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:04:32.374326162 (104h38m54.333423397s) [upload=109052]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:04:32.463401205 (104h38m54.422498463s) [upload=109052]: Done uploading segments... Aug 13 02:04:32.463636481 (104h38m54.422733738s) [upload=109052]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.387149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............................X................X.XX.........X] duration:
1.826071257s
FAIL (2025-08-13 02:03:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:03:51.064512008 (104h38m13.023609257s) [upload=109040]: Starting upload
Aug 13 02:03:51.064589095 (104h38m13.023686342s) [upload=109040]: Done starting upload
Aug 13 02:03:51.064820376 (104h38m13.023917625s) [upload=109040]: Uploading segments...
Aug 13 02:03:51.065203432 (104h38m13.024300678s) [upload=109040]: Got next segment. Inline: false
Aug 13 02:03:51.065266516 (104h38m13.024363766s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:03:51.065273895 (104h38m13.024371144s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:03:51.342641574 (104h38m13.30173883s) [seg_pos={0 0}, upload=109040]: Begin upload segment...
Aug 13 02:03:51.342698831 (104h38m13.301796087s) [seg_pos={0 0}, upload=109040]: Done begin upload segment.
Aug 13 02:03:51.342729350 (104h38m13.301826602s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362131698 (104h38m13.321228954s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.362628060 (104h38m13.321725316s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363038092 (104h38m13.322135348s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363439585 (104h38m13.32253684s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.363807880 (104h38m13.322905136s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364212520 (104h38m13.323309778s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364604687 (104h38m13.323701942s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.364988479 (104h38m13.324085735s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365357755 (104h38m13.324455011s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.365713400 (104h38m13.324810656s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366108098 (104h38m13.32520535s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366484321 (104h38m13.32558158s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.366847444 (104h38m13.3259447s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367212081 (104h38m13.326309336s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367588003 (104h38m13.326685261s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.367942609 (104h38m13.327039861s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.368295557 (104h38m13.327392812s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Uploading piece...
Aug 13 02:03:51.959748928 (104h38m13.918846159s) [upload=109040]: Next returned nil segment
Aug 13 02:03:51.959766412 (104h38m13.918863657s) [upload=109040]: Waiting for error group managing segments...
Aug 13 02:03:52.135265216 (104h38m14.094362454s) [noise=true , address=104.36.82.58:4267 , piece_id=7LXBDMZXAJZ2UUHSXA7N5K36T3NZHVDKEUIJVY3TSHB2KHE6LEUQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135478765 (104h38m14.094575998s) [noise=true , address=104.36.82.6:4891 , piece_id=OK36RMNPMGC2OQTCGAM7XP7JMCVQPG6YRB3WMOPDYIAJD65LMGKQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.135706416 (104h38m14.094803656s) [noise=true , address=104.36.82.43:4846 , piece_id=M6GV6X5CM4H57SDH5VRGZNAQ4TAMFPNYL6TJOSREY3ASIUYNYLGQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.139937345 (104h38m14.099034579s) [noise=true , address=104.36.82.23:4450 , piece_id=EULM2APGL4QLODTFS6TTYWKZ7I6CQ3PCV5Q4CQVTHE5IKWQGBUSA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.153728561 (104h38m14.112825796s) [noise=true , address=104.36.82.4:4826 , piece_id=652B2PDIBSJZXPWG6GE6SIAXRAVZA4CIB7INWWENZXAUNQWD5OAQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.160896556 (104h38m14.119993811s) [noise=true , address=104.36.82.37:4664 , piece_id=5DQ4PP35APGEMASJRDIOLHRX33CGXXKNPES2QDMSBNDUPBUNGKFA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.164736086 (104h38m14.12383332s) [noise=true , address=104.36.82.38:4699 , piece_id=KKGHKFUHKX5265HOOSPWFW3LRWO2K6QHMQ4YUESP5T44NKBXL7JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.167025917 (104h38m14.126123149s) [noise=true , address=104.36.82.17:4333 , piece_id=DF2FAYU5JJBPUSWFJ5NFUWHU25ZM37LLLUXLPFR6DBTJUAJXQ3PA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168291674 (104h38m14.127388909s) [noise=true , address=77.90.31.15:4703 , piece_id=OOGBNWWDUHKSALOV4SHXKA3SYIEKUZOMYBE2WWUTQCH3AAI7T3UQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.168797127 (104h38m14.127894374s) [noise=true , address=104.36.82.9:4028 , piece_id=6OLMA7XNIJSP7YPQ47UVUGFH4HSNQV5QYOPICTBZYNHXKH45G4RQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.171967981 (104h38m14.131065231s) [noise=true , address=104.36.82.22:4542 , piece_id=XLHO3NWQGPVP3LJFDU4JJW4WFKDVIMYKGTXMDVSSHRG3RCR7N7LQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.181307990 (104h38m14.140405226s) [noise=true , address=104.36.82.13:4190 , piece_id=BZXQ7N6O3G2MSWMTINZLMMPRKYAE7YTDDRXYBWSJ5I7QBDEG5ZHQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.191660792 (104h38m14.150758038s) [noise=true , address=104.36.82.34:4547 , piece_id=DY4ML4LYZUUCR3JBTUSMWUSIZYMPOEUNRQD5UIJYWZYRMZ7QVK7A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212873680 (104h38m14.171970912s) [noise=true , address=77.90.31.21:4895 , piece_id=CEZM4QA6IFL5EBUMWOJWYVVR275PZGF2P2E76RJCRIQSTEI6T2WA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: <nil>
Aug 13 02:03:52.212903738 (104h38m14.172000988s) [seg_pos={0 0}, upload=109040]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:03:52.213106836 (104h38m14.172204067s) [noise=true , address=104.36.82.62:4440 , piece_id=VDGO7HIYS3GBAE7KNIDD3NCCN2POE4I3VKOJFOGTJAOE5MQFJ2JQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213319244 (104h38m14.172416475s) [noise=true , address=104.36.82.61:4394 , piece_id=B77CCWYRMZOHVHQPQZXLKG6RHPE22LCMGWFK4XCCCEBH6ERMMO6A, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dSpTqCxeAcL9PVYbP7BhmuKE7papFPc9swB1Fy83WcFDgQbcF): protocol: expected piece hash; context canceled; EOF
Aug 13 02:03:52.213367391 (104h38m14.172464628s) [noise=true , address=66.23.193.175:4558 , piece_id=ROK3KGOIR7GCXRPOZSNJCDYNGS4IDXX4DOLLEFQILDJ6XGSXC4CQ, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55408->66.23.193.175:4558: use of closed network connection
Aug 13 02:03:52.213395652 (104h38m14.172492891s) [noise=true , address=64.49.13.139:4480 , piece_id=XQWUB3UHXGEPJSYV42P4LLPAW7ZA5MEJP6HPP4HNQGO4FZRT7YZA, seg_pos={0 0}, upload=109040]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35048->64.49.13.139:4480: use of closed network connection
Aug 13 02:03:52.213409163 (104h38m14.172506402s) [seg_pos={0 0}, upload=109040]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:03:52.213499652 (104h38m14.1725969s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:03:52.213504887 (104h38m14.172602132s) [upload=109040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:03:52.413685793 (104h38m14.372783048s) [upload=109040]: Done uploading segments...
Aug 13 02:03:52.413712130 (104h38m14.372809378s) [upload=109040]: Upload finished. err: <nil>
Duration: 1.826101426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration:
845.448425ms
FAIL (2025-08-13 02:03:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 845.485728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................X................X.XX.........] duration:
2.583574074s
FAIL (2025-08-13 02:03:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.583604862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X......................X............] duration:
898.940032ms
FAIL (2025-08-13 02:03:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 898.974745ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X................X.XX........] duration:
2.522387941s
FAIL (2025-08-13 02:02:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.522433698s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration:
845.941136ms
FAIL (2025-08-13 02:02:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 845.981902ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration:
886.95499ms
FAIL (2025-08-13 02:01:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 887.044733ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X................X.XX.......] duration:
2.516105244s
FAIL (2025-08-13 02:01:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.516140944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration:
918.561765ms
FAIL (2025-08-13 02:00:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 918.605072ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X................X.XX......] duration:
2.452103684s
FAIL (2025-08-13 02:00:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.452221509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X......................X........] duration:
847.775237ms
FAIL (2025-08-13 01:59:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 847.814319ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................X................X.XX.....] duration:
2.351523591s
FAIL (2025-08-13 01:59:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.351577884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration:
856.014574ms
FAIL (2025-08-13 01:58:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 856.102574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................X................X.XX....] duration:
2.407405285s
FAIL (2025-08-13 01:58:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.407439282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X......................X......] duration:
851.303547ms
FAIL (2025-08-13 01:58:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 851.342122ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X......................X.....] duration:
990.492925ms
FAIL (2025-08-13 01:57:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 990.524149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................X................X.XX...] duration:
2.857285637s
FAIL (2025-08-13 01:57:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.857318825s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X......................X....] duration:
835.143222ms
FAIL (2025-08-13 01:56:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 835.181412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................X................X.XX..] duration:
2.628158397s
FAIL (2025-08-13 01:56:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.628194177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......................X...] duration:
879.725663ms
FAIL (2025-08-13 01:55:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 879.756605ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................................X................X.XX.] duration:
2.573284287s
FAIL (2025-08-13 01:55:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.573313211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......................X..] duration:
889.98787ms
FAIL (2025-08-13 01:55:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 890.03171ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................................X................X.XX] duration:
2.394504025s
FAIL (2025-08-13 01:54:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 39fb6b93e92fb33d2c814620ed47eb258d181356b938275b14accc14d3618431 != before bb2673b3fe9f2291ea4e2915cfe7ba4800a0172e68b70164d2beac2d49b01bfd
======LOGS======
Aug 13 01:54:57.843565868 (104h29m19.802663127s) [upload=108891]: Starting upload
Aug 13 01:54:57.843675318 (104h29m19.802772572s) [upload=108891]: Done starting upload
Aug 13 01:54:57.843790597 (104h29m19.802887847s) [upload=108891]: Uploading segments...
Aug 13 01:54:57.844095497 (104h29m19.803192742s) [upload=108891]: Got next segment. Inline: false
Aug 13 01:54:57.844151524 (104h29m19.803248769s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:57.844157322 (104h29m19.803254567s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:58.040327303 (104h29m19.999424545s) [seg_pos={0 0}, upload=108891]: Begin upload segment...
Aug 13 01:54:58.040403968 (104h29m19.999501207s) [seg_pos={0 0}, upload=108891]: Done begin upload segment.
Aug 13 01:54:58.040433458 (104h29m19.99953071s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.040991367 (104h29m20.000088615s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041334276 (104h29m20.000431521s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041638481 (104h29m20.000735731s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.041965023 (104h29m20.001062268s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046279243 (104h29m20.005376498s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.046841026 (104h29m20.005938281s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047443437 (104h29m20.006540691s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.047902641 (104h29m20.006999896s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.048441250 (104h29m20.007538507s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049070066 (104h29m20.00816732s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.049753576 (104h29m20.008850834s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.050569095 (104h29m20.009666349s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051181092 (104h29m20.010278348s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.051671354 (104h29m20.010768606s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052250110 (104h29m20.011347362s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.052773512 (104h29m20.011870761s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.053240030 (104h29m20.012337286s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Uploading piece...
Aug 13 01:54:58.637248918 (104h29m20.59634617s) [upload=108891]: Next returned nil segment
Aug 13 01:54:58.637272722 (104h29m20.596369978s) [upload=108891]: Waiting for error group managing segments...
Aug 13 01:54:58.817624443 (104h29m20.776721681s) [noise=true , address=104.36.82.4:4810 , piece_id=MUDPJ5D3XEW74OSZB2OIH3OHIO4J6B72ERQPEKDISM7QBI5MFWDA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.818053495 (104h29m20.77715074s) [noise=true , address=104.36.82.35:4582 , piece_id=ISYT5DUFP2XV5CVTQ726UKV56Y34JVKPSGAE4SCMO3S2EKY5BQUA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.821537715 (104h29m20.780634952s) [noise=true , address=104.36.82.46:4501 , piece_id=A3FYPAKRCTJWMSJPME3BVDIQJQCAIXQW4DA7IH6D3NLWEUYDZLJQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.823466051 (104h29m20.782563282s) [noise=true , address=104.36.82.47:4545 , piece_id=XF24TEMQ5XYAXQNS2I5MN3Y67DQGERDBWGYPBYZHU4MHW6WLCNWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.824793835 (104h29m20.783891084s) [noise=true , address=104.36.82.36:4646 , piece_id=LLGNU57U4P7UQZH24PCDEQJ2RTW3SE2L3DKTKQYZCPQGHXWC55CQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.832337320 (104h29m20.791434561s) [noise=true , address=104.36.82.50:4013 , piece_id=X4WK242NEEZBCYQAB5NR44W3A66T3KPT37VZJ37EFBD6ERKQI4YA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.833885199 (104h29m20.792982437s) [noise=true , address=104.36.82.17:4364 , piece_id=AIBEHXGFCZXVPZU74YFYYNU7MGOCJQU6FOEQ3OPRGTTI27H33LLA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.835039844 (104h29m20.794137083s) [noise=true , address=104.36.82.23:4448 , piece_id=ZHI57QGKQVNR4H6TLSO227TMNZUKHNIPIREF2VJY7242MDGKVVWA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838266651 (104h29m20.797363889s) [noise=true , address=104.36.82.18:4367 , piece_id=OKWQMFGJ4RKTOSVAW4TFIWRROAZQXHTSISYIMY7UPANALGGH4KPQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.838535676 (104h29m20.797632915s) [noise=true , address=104.36.82.39:4742 , piece_id=3MYKGFD5GEH6CNP6IF4DKLK73R57OD57WPI7433JUGNUTCQ55U6Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.842387903 (104h29m20.801485137s) [noise=true , address=77.90.31.13:4629 , piece_id=OGVSZGPG476DOBDXYR4PLPVLYG5RGTKAG7EK5VQUTPL7TSQ7ROGQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.847444242 (104h29m20.806541479s) [noise=true , address=45.91.116.5:4309 , piece_id=LTVVJGTDLQFMNEYZOKO6VKF62IB23L35BLHEMYZKF3HQGOPAUUIQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.861861283 (104h29m20.820958522s) [noise=true , address=104.36.82.3:4770 , piece_id=RRQZGYOISJI5PDWOWGEAXSEM6YW46TAONA2B4SGSGNOOXK5AY2TQ, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885708761 (104h29m20.844805999s) [noise=true , address=77.90.31.14:4694 , piece_id=AVU33TFM64WN43ELALABWFVTTTTJN6JGHUEBRRPRTOMYUA4CZEOA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: <nil>
Aug 13 01:54:58.885745001 (104h29m20.844842246s) [seg_pos={0 0}, upload=108891]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:58.885901711 (104h29m20.844998949s) [noise=true , address=79.127.201.215:4349 , piece_id=EXCBEHXHGAS5YIZL5NQRHD2IE6ZWT2DLJRUO6XMKYQK7B22UBD7Q, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.885959454 (104h29m20.8450567s) [noise=true , address=104.36.82.51:4058 , piece_id=B2XW2KS7JMWTE5HUIVCQWBAWQQVKYLLF3QLFYRMMSS64KKUGDC2A, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6J9mfHN8XiwHLAMaJVjAnaLqbx1oUoQSa5AkmcA9TqEpPnSJ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:58.886171058 (104h29m20.845268294s) [noise=true , address=64.49.13.170:4726 , piece_id=HAI7ZPAMXHUWRE75RPWJOPIKIJ356GZFTWFYLCVRAAKWH3BA7BJA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50744->64.49.13.170:4726: use of closed network connection
Aug 13 01:54:58.886185561 (104h29m20.845282801s) [noise=true , address=64.49.13.169:4716 , piece_id=BPEVJMSTX4WTTUQTWPHQY3KC4TZCK5ZNEPQPFQN44QJVWXKKEYAA, seg_pos={0 0}, upload=108891]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53442->64.49.13.169:4716: use of closed network connection
Aug 13 01:54:58.886202300 (104h29m20.845299545s) [seg_pos={0 0}, upload=108891]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:58.886278282 (104h29m20.845375528s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:58.886283300 (104h29m20.845380545s) [upload=108891]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:59.045284193 (104h29m21.004381449s) [upload=108891]: Done uploading segments...
Aug 13 01:54:59.045315707 (104h29m21.004412953s) [upload=108891]: Upload finished. err: <nil>
Duration: 2.394539601s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................................X................X.X] duration:
2.50514543s
FAIL (2025-08-13 01:54:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 01fa136c3b4dd4a0c3a638a92c51f300a74166fa4d58655e5e049691d674d73d != before 90b0cae8fe51341c018b043085a5128b137ad92cd4eccd864565da60937d56ee
======LOGS======
Aug 13 01:54:20.167965907 (104h28m42.127063141s) [upload=108879]: Starting upload
Aug 13 01:54:20.168074478 (104h28m42.127171718s) [upload=108879]: Done starting upload
Aug 13 01:54:20.168611999 (104h28m42.127709239s) [upload=108879]: Uploading segments...
Aug 13 01:54:20.168686027 (104h28m42.127783275s) [upload=108879]: Got next segment. Inline: false
Aug 13 01:54:20.168727735 (104h28m42.12782497s) [upload=108879]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:54:20.168733823 (104h28m42.12783107s) [upload=108879]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:54:20.371504691 (104h28m42.33060195s) [seg_pos={0 0}, upload=108879]: Begin upload segment...
Aug 13 01:54:20.371577338 (104h28m42.330674576s) [seg_pos={0 0}, upload=108879]: Done begin upload segment.
Aug 13 01:54:20.371610950 (104h28m42.330708204s) [noise=true , address=104.36.82.5:4846 , piece_id=FWLQJ3BSRCOV6D2N3J4ETU5K3K5VR4TBTDNYFSGH26X4MWHAFTSA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.371706478 (104h28m42.330803736s) [noise=true , address=77.90.31.21:4899 , piece_id=74EUEW5EGVHY2QECZLBTQTP62XOQHVZCNTUUMA6F3YSUDKHJWHMA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.372100991 (104h28m42.331198249s) [noise=true , address=77.90.31.14:4686 , piece_id=WDDBHEAO7VXYI3SZJBQYAJGUOGYMRSPRBLWDZBZHF3GSXBLEFBZA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.372441272 (104h28m42.331538524s) [noise=true , address=104.36.82.13:4202 , piece_id=LKD2VZSWIG7YQAII4QYYIZAQQUWGOBH6K6RKFP275E5XL7PPSRFA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.372510231 (104h28m42.331607488s) [noise=true , address=104.36.82.38:4691 , piece_id=D3FIG56BR646LSLXVIPN5KL556HMX2KB4ZYUMJITPBCKM77DANRA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.372877144 (104h28m42.3319744s) [noise=true , address=77.90.31.15:4719 , piece_id=TXELYUPWX7EAAGPSXZEC5YU44P3ZBMIHO6YCRY7VSVTKUX6B2UZQ, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.373082937 (104h28m42.332180193s) [noise=true , address=104.36.82.59:4303 , piece_id=D44UT2CDMRUT5SE63G6ILYJBLOL344RKB4KVGT4647LGCMW2QMXQ, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.373482666 (104h28m42.332579924s) [noise=true , address=104.36.82.8:4998 , piece_id=E7XBJUDQSHE6B4OFCNER6GS267YGIJIMNUMXWPTJ7BKHBPOGZEUQ, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.373799709 (104h28m42.332896967s) [noise=true , address=64.49.13.138:4488 , piece_id=RNYEGPHAC6L5HF25NJTTQ24H3KHZECA3BYOEFUU6BVHL57YOHK2A, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.373986991 (104h28m42.333084243s) [noise=true , address=104.36.82.60:4370 , piece_id=KGAG4NJKD7J7AZ2MKDKRXJQEOJMKGR5RTMRIQETQ6HSHHS3OJRYA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.374398604 (104h28m42.333495909s) [noise=true , address=79.127.219.38:4035 , piece_id=CBJJYOATNLJKJNGNUMMCWSRUQJQQRN4RPYRW77TNEMJB5NYJ53MQ, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.374415077 (104h28m42.333512339s) [noise=true , address=104.36.82.46:4497 , piece_id=MFAHMYIRMABME3MCW4NDBQVTAYMBS5GV5QWHPRVU4I5OM75D4TXA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.374766113 (104h28m42.333863371s) [noise=true , address=104.36.82.17:4353 , piece_id=NP4MNM5YC44XDAKOAUEWPJAGZTLEQSV7FVNYAXSLJOTAG2JNJR4Q, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.374975193 (104h28m42.33407245s) [noise=true , address=104.36.82.39:4750 , piece_id=CBJA3NSPKLJSKO764KBKOYE6FKOOMOC5QAQIOKYXSBXKCH3TD3EA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.375176943 (104h28m42.334274202s) [noise=true , address=104.36.82.43:4858 , piece_id=SKZR3RZCK3PQVFK7AYEP3OK3MLU5H6YCDSOQXBZOLKGKWHZ7WECQ, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.375578078 (104h28m42.334675337s) [noise=true , address=104.36.82.61:4379 , piece_id=JIHEMRH2PTRQKVXL2RDC6XOZINN3E2OX2MC33XZRQTI7NMPE3N6Q, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.379468468 (104h28m42.338565728s) [noise=true , address=104.36.82.62:4412 , piece_id=Y57BJA5YTUNW66JMEOXYM2PWFPC6NRBZTESB5NHIDB7X7XHLDGIA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.380977333 (104h28m42.340074601s) [noise=true , address=104.36.82.34:4564 , piece_id=WKDIVQ7KRSI42MBQSVZR43G3SS3BDTMAF6GQCSCAUQGA57MN45OA, seg_pos={0 0}, upload=108879]: Uploading piece...
Aug 13 01:54:20.951967681 (104h28m42.911064937s) [upload=108879]: Next returned nil segment
Aug 13 01:54:20.951987258 (104h28m42.911084522s) [upload=108879]: Waiting for error group managing segments...
Aug 13 01:54:21.120434925 (104h28m43.079532157s) [noise=true , address=77.90.31.21:4899 , piece_id=74EUEW5EGVHY2QECZLBTQTP62XOQHVZCNTUUMA6F3YSUDKHJWHMA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.123097126 (104h28m43.082194374s) [noise=true , address=77.90.31.14:4686 , piece_id=WDDBHEAO7VXYI3SZJBQYAJGUOGYMRSPRBLWDZBZHF3GSXBLEFBZA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.124506767 (104h28m43.083604017s) [noise=true , address=104.36.82.34:4564 , piece_id=WKDIVQ7KRSI42MBQSVZR43G3SS3BDTMAF6GQCSCAUQGA57MN45OA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.132381917 (104h28m43.091479165s) [noise=true , address=104.36.82.38:4691 , piece_id=D3FIG56BR646LSLXVIPN5KL556HMX2KB4ZYUMJITPBCKM77DANRA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.139515231 (104h28m43.098612463s) [noise=true , address=104.36.82.61:4379 , piece_id=JIHEMRH2PTRQKVXL2RDC6XOZINN3E2OX2MC33XZRQTI7NMPE3N6Q, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.144380596 (104h28m43.103477834s) [noise=true , address=79.127.219.38:4035 , piece_id=CBJJYOATNLJKJNGNUMMCWSRUQJQQRN4RPYRW77TNEMJB5NYJ53MQ, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.148037486 (104h28m43.107134724s) [noise=true , address=104.36.82.43:4858 , piece_id=SKZR3RZCK3PQVFK7AYEP3OK3MLU5H6YCDSOQXBZOLKGKWHZ7WECQ, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.153375570 (104h28m43.112472817s) [noise=true , address=104.36.82.8:4998 , piece_id=E7XBJUDQSHE6B4OFCNER6GS267YGIJIMNUMXWPTJ7BKHBPOGZEUQ, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.153942639 (104h28m43.113039871s) [noise=true , address=104.36.82.60:4370 , piece_id=KGAG4NJKD7J7AZ2MKDKRXJQEOJMKGR5RTMRIQETQ6HSHHS3OJRYA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.162061527 (104h28m43.121158762s) [noise=true , address=104.36.82.39:4750 , piece_id=CBJA3NSPKLJSKO764KBKOYE6FKOOMOC5QAQIOKYXSBXKCH3TD3EA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.171257344 (104h28m43.130354592s) [noise=true , address=104.36.82.46:4497 , piece_id=MFAHMYIRMABME3MCW4NDBQVTAYMBS5GV5QWHPRVU4I5OM75D4TXA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.175633795 (104h28m43.134731051s) [noise=true , address=104.36.82.17:4353 , piece_id=NP4MNM5YC44XDAKOAUEWPJAGZTLEQSV7FVNYAXSLJOTAG2JNJR4Q, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.187028759 (104h28m43.146125997s) [noise=true , address=77.90.31.15:4719 , piece_id=TXELYUPWX7EAAGPSXZEC5YU44P3ZBMIHO6YCRY7VSVTKUX6B2UZQ, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.210593410 (104h28m43.169690657s) [noise=true , address=104.36.82.5:4846 , piece_id=FWLQJ3BSRCOV6D2N3J4ETU5K3K5VR4TBTDNYFSGH26X4MWHAFTSA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: <nil>
Aug 13 01:54:21.210638165 (104h28m43.169735411s) [seg_pos={0 0}, upload=108879]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:54:21.210830550 (104h28m43.169927784s) [noise=true , address=104.36.82.62:4412 , piece_id=Y57BJA5YTUNW66JMEOXYM2PWFPC6NRBZTESB5NHIDB7X7XHLDGIA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:21.210916042 (104h28m43.170013273s) [noise=true , address=104.36.82.13:4202 , piece_id=LKD2VZSWIG7YQAII4QYYIZAQQUWGOBH6K6RKFP275E5XL7PPSRFA, seg_pos={0 0}, upload=108879]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:21.210993238 (104h28m43.170090475s) [noise=true , address=104.36.82.59:4303 , piece_id=D44UT2CDMRUT5SE63G6ILYJBLOL344RKB4KVGT4647LGCMW2QMXQ, seg_pos={0 0}, upload=108879]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gJKrCBLJWN1SBKibfeqBtcqqiv4veKTGmtnycjZyb3VN9kwoT): protocol: expected piece hash; context canceled; EOF
Aug 13 01:54:21.211221610 (104h28m43.170318849s) [noise=true , address=64.49.13.138:4488 , piece_id=RNYEGPHAC6L5HF25NJTTQ24H3KHZECA3BYOEFUU6BVHL57YOHK2A, seg_pos={0 0}, upload=108879]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQqzHsTJvR5wHpEGXDixk3NcRuBKxY2cL82eJMHidcxFiPCZb): protocol: write tcp 139.59.144.22:60668->64.49.13.138:4488: use of closed network connection; write tcp 139.59.144.22:60668->64.49.13.138:4488: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60668->64.49.13.138:4488: use of closed network connection
Aug 13 01:54:21.211238907 (104h28m43.170336157s) [seg_pos={0 0}, upload=108879]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:54:21.211323498 (104h28m43.170420744s) [upload=108879]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:54:21.211329306 (104h28m43.170426552s) [upload=108879]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:54:21.535533912 (104h28m43.494631187s) [upload=108879]: Done uploading segments...
Aug 13 01:54:21.535563221 (104h28m43.494660461s) [upload=108879]: Upload finished. err: <nil>
Duration: 2.505184138s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......................X.] duration:
864.265223ms
FAIL (2025-08-13 01:54:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 864.299771ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X................X.] duration:
2.491398789s
FAIL (2025-08-13 01:53:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 01:52:57.490606480 (104h27m19.449703729s) [upload=108854]: Starting upload
Aug 13 01:52:57.490667677 (104h27m19.449764931s) [upload=108854]: Done starting upload
Aug 13 01:52:57.490974422 (104h27m19.450071667s) [upload=108854]: Uploading segments...
Aug 13 01:52:57.491088041 (104h27m19.450185287s) [upload=108854]: Got next segment. Inline: false
Aug 13 01:52:57.491128989 (104h27m19.450226234s) [upload=108854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 01:52:57.491134219 (104h27m19.450231464s) [upload=108854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 01:52:57.699735381 (104h27m19.658832614s) [seg_pos={0 0}, upload=108854]: Begin upload segment...
Aug 13 01:52:57.699805669 (104h27m19.658902901s) [seg_pos={0 0}, upload=108854]: Done begin upload segment.
Aug 13 01:52:57.699855630 (104h27m19.658952881s) [noise=true , address=104.36.82.23:4446 , piece_id=L7TOCLRV3ELC46CQH7BRVIRSA6CQSAZUQIVCOGWPGRQR3OSYK4GA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.700406733 (104h27m19.659504004s) [noise=true , address=104.36.82.35:4602 , piece_id=QH4KUC3PYBERQD4CRKPDP6H4OBSINCBUQHOF5ZCC5Q54NYZQSLJA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.700779288 (104h27m19.65987656s) [noise=true , address=104.36.82.61:4407 , piece_id=T4PYKK5DSZ7Y7DJ2AH2XCN3ASVES33223MX4KMRRMG7JYSIYKFVA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.701440927 (104h27m19.660538175s) [noise=true , address=64.49.13.140:4510 , piece_id=7CNAXER2S22YQN2D6FF7FP2C54BNMEPQ2IJCB2LQQO5WGFA6K5GQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.701981925 (104h27m19.661079175s) [noise=true , address=77.90.31.17:4781 , piece_id=DHZAJ7MQ3G2KHTKHWAOCCIXTDTQPTEKGXSMKESFJEVYHYRBVELLA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.702368696 (104h27m19.66146595s) [noise=true , address=104.36.82.7:4924 , piece_id=7C77LI7KIXT2Z7YYVFKUXHB5VVZC6TXUSX5DZ6NMBXYAQ6SVZY3Q, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.702635895 (104h27m19.66173314s) [noise=true , address=104.36.82.18:4395 , piece_id=GUMT56PHBWEJFIZ4PV5YNFZS2CWL6XHPWEQ7G7LUJ3ZPI5DZ52RA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.703139459 (104h27m19.662236715s) [noise=true , address=104.36.82.22:4544 , piece_id=NH7DRW7NM2KFCN46VGKFMDTLXY5Y234ZYCMMHUAFE3RX2HSYKXZQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.703548595 (104h27m19.662645841s) [noise=true , address=104.36.82.59:4326 , piece_id=XVASIPHYDRCWWVMCZIDXQLXEULCSIAYCUJN44CNC2SFWHEQ74XQQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.703922704 (104h27m19.663019959s) [noise=true , address=104.36.82.9:4025 , piece_id=5A4KRNNLWRNLSBXALAR4SRYDTNDBHOYXWTIDB3AFNH7I4L7T3RSQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.704342022 (104h27m19.663439287s) [noise=true , address=79.127.201.215:4356 , piece_id=ZNZE4OPSSFCTDGKBU4T544FBJYI5QDKCA7XYYSIM4TA6R52FQXRQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.704648017 (104h27m19.663745262s) [noise=true , address=104.36.82.62:4430 , piece_id=AR4K7D7VV4J2F7R734IBPJB3WLAK4LX7R5SVROHYKY6D64UJQLNA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.704989832 (104h27m19.664087084s) [noise=true , address=104.36.82.43:4861 , piece_id=UOKGPW2NYKE5VJYOYHTRXOHHWVRE4P3I6F55U4BP7GKUHVGXYZ2Q, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.705474602 (104h27m19.664571853s) [noise=true , address=77.90.31.12:4603 , piece_id=OQ3L4SQHR7N755VS2JPC3OSUTJAUYM2643UEKYC6R5QICXESB3MQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.705769497 (104h27m19.664866745s) [noise=true , address=104.36.82.60:4353 , piece_id=Q6DLNRWUTDMEHYA4TLHP5Y4JVESL5XRQ2R6RH7IKCZKQ2F36IYZQ, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.706271921 (104h27m19.66536917s) [noise=true , address=104.36.82.3:4771 , piece_id=G73FCFGZAJ3S7XKTZFH5UVON3LBQTPBVAMQGGANKSRA4ZV6AIS7Q, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.706580482 (104h27m19.665677728s) [noise=true , address=64.49.13.139:4479 , piece_id=YSNK7TWMAOPSWJPF5BUWQPPBPIFVCDRMTDVOCT4ELM2KCLS5F6CA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:57.706847939 (104h27m19.665945184s) [noise=true , address=104.36.82.37:4653 , piece_id=N6HLWBTHJ5NGXVKMQ5APLDXQFHBBJKAG63ZSBYOSPSIDKUTTLKFA, seg_pos={0 0}, upload=108854]: Uploading piece...
Aug 13 01:52:58.272828415 (104h27m20.231925652s) [upload=108854]: Next returned nil segment
Aug 13 01:52:58.273593768 (104h27m20.232691014s) [upload=108854]: Waiting for error group managing segments...
Aug 13 01:52:58.434421097 (104h27m20.393518345s) [noise=true , address=77.90.31.17:4781 , piece_id=DHZAJ7MQ3G2KHTKHWAOCCIXTDTQPTEKGXSMKESFJEVYHYRBVELLA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.447068053 (104h27m20.406165299s) [noise=true , address=104.36.82.35:4602 , piece_id=QH4KUC3PYBERQD4CRKPDP6H4OBSINCBUQHOF5ZCC5Q54NYZQSLJA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.449642724 (104h27m20.408739959s) [noise=true , address=104.36.82.22:4544 , piece_id=NH7DRW7NM2KFCN46VGKFMDTLXY5Y234ZYCMMHUAFE3RX2HSYKXZQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.452703055 (104h27m20.411800294s) [noise=true , address=77.90.31.12:4603 , piece_id=OQ3L4SQHR7N755VS2JPC3OSUTJAUYM2643UEKYC6R5QICXESB3MQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.455266880 (104h27m20.414364119s) [noise=true , address=104.36.82.9:4025 , piece_id=5A4KRNNLWRNLSBXALAR4SRYDTNDBHOYXWTIDB3AFNH7I4L7T3RSQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.455413123 (104h27m20.414510359s) [noise=true , address=104.36.82.18:4395 , piece_id=GUMT56PHBWEJFIZ4PV5YNFZS2CWL6XHPWEQ7G7LUJ3ZPI5DZ52RA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.461425319 (104h27m20.420522576s) [noise=true , address=104.36.82.61:4407 , piece_id=T4PYKK5DSZ7Y7DJ2AH2XCN3ASVES33223MX4KMRRMG7JYSIYKFVA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.470093073 (104h27m20.429190312s) [noise=true , address=104.36.82.23:4446 , piece_id=L7TOCLRV3ELC46CQH7BRVIRSA6CQSAZUQIVCOGWPGRQR3OSYK4GA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.471680108 (104h27m20.430777347s) [noise=true , address=104.36.82.43:4861 , piece_id=UOKGPW2NYKE5VJYOYHTRXOHHWVRE4P3I6F55U4BP7GKUHVGXYZ2Q, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.473908201 (104h27m20.433023806s) [noise=true , address=104.36.82.7:4924 , piece_id=7C77LI7KIXT2Z7YYVFKUXHB5VVZC6TXUSX5DZ6NMBXYAQ6SVZY3Q, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.485599218 (104h27m20.444696451s) [noise=true , address=104.36.82.62:4430 , piece_id=AR4K7D7VV4J2F7R734IBPJB3WLAK4LX7R5SVROHYKY6D64UJQLNA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.502005583 (104h27m20.461102832s) [noise=true , address=104.36.82.59:4326 , piece_id=XVASIPHYDRCWWVMCZIDXQLXEULCSIAYCUJN44CNC2SFWHEQ74XQQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.550323798 (104h27m20.50942103s) [noise=true , address=104.36.82.3:4771 , piece_id=G73FCFGZAJ3S7XKTZFH5UVON3LBQTPBVAMQGGANKSRA4ZV6AIS7Q, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.560738118 (104h27m20.519835361s) [noise=true , address=104.36.82.37:4653 , piece_id=N6HLWBTHJ5NGXVKMQ5APLDXQFHBBJKAG63ZSBYOSPSIDKUTTLKFA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: <nil>
Aug 13 01:52:58.560778612 (104h27m20.519875859s) [seg_pos={0 0}, upload=108854]: Segment reached optimal threshold of 14 pieces.
Aug 13 01:52:58.560961153 (104h27m20.520058385s) [noise=true , address=104.36.82.60:4353 , piece_id=Q6DLNRWUTDMEHYA4TLHP5Y4JVESL5XRQ2R6RH7IKCZKQ2F36IYZQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 13 01:52:58.561044912 (104h27m20.520142147s) [noise=true , address=79.127.201.215:4356 , piece_id=ZNZE4OPSSFCTDGKBU4T544FBJYI5QDKCA7XYYSIM4TA6R52FQXRQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 01:52:58.561074057 (104h27m20.520171304s) [noise=true , address=64.49.13.139:4479 , piece_id=YSNK7TWMAOPSWJPF5BUWQPPBPIFVCDRMTDVOCT4ELM2KCLS5F6CA, seg_pos={0 0}, upload=108854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fa8o8SX7mogECREbm3fLwNDTNT4qVGSa8NUwaG1GkNe96FFqw): protocol: write tcp 139.59.144.22:55486->64.49.13.139:4479: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.139:4479: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.139:4479: use of closed network connection
Aug 13 01:52:58.561337913 (104h27m20.52043516s) [noise=true , address=64.49.13.140:4510 , piece_id=7CNAXER2S22YQN2D6FF7FP2C54BNMEPQ2IJCB2LQQO5WGFA6K5GQ, seg_pos={0 0}, upload=108854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:53398->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:53398->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53398->64.49.13.140:4510: use of closed network connection
Aug 13 01:52:58.561380078 (104h27m20.520477327s) [seg_pos={0 0}, upload=108854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 01:52:58.561497594 (104h27m20.520594838s) [upload=108854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 01:52:58.561503175 (104h27m20.520600421s) [upload=108854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 01:52:58.729220570 (104h27m20.688317826s) [upload=108854]: Done uploading segments...
Aug 13 01:52:58.729262876 (104h27m20.688360122s) [upload=108854]: Upload finished. err: <nil>
Duration: 2.491428291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
731.919629ms
FAIL (2025-08-13 01:53:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0d1c0ead6d0035a2444ecd45f8fbfc26b6d22d76bcb7f3d08518be10e8791181 != before 8309c11b0f3878f96ee326b620f9027a50fc09828a361e6fa452bc7a4d338eca ======LOGS====== Aug 13 01:53:09.964029993 (104h27m31.923127251s) [upload=108859]: Starting upload Aug 13 01:53:09.964115505 (104h27m31.923212763s) [upload=108859]: Done starting upload Aug 13 01:53:09.964245757 (104h27m31.92334299s) [upload=108859]: Uploading segments... Aug 13 01:53:09.964323655 (104h27m31.92342091s) [upload=108859]: Got next segment. Inline: true Aug 13 01:53:09.964346508 (104h27m31.923443765s) [upload=108859]: Waiting for error group managing segments... Aug 13 01:53:09.964422738 (104h27m31.923519985s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 01:53:09.964429893 (104h27m31.923527148s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 01:53:09.964433921 (104h27m31.923531178s) [upload=108859]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 01:53:10.117472359 (104h27m32.076569619s) [upload=108859]: Done uploading segments... Aug 13 01:53:10.117523726 (104h27m32.07662096s) [upload=108859]: Upload finished. err: <nil>
Duration: 731.950156ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|