Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...............X................] duration:
845.326002ms
FAIL (2025-08-15 01:16:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 845.360152ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X...............................X........X.X.] duration:
2.671016664s
FAIL (2025-08-15 01:16:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:16:13.411893619 (151h50m35.370990868s) [upload=158214]: Starting upload Aug 15 01:16:13.411947074 (151h50m35.37104432s) [upload=158214]: Done starting upload Aug 15 01:16:13.412160124 (151h50m35.371257383s) [upload=158214]: Uploading segments... Aug 15 01:16:13.412278005 (151h50m35.371375257s) [upload=158214]: Got next segment. Inline: false Aug 15 01:16:13.412344026 (151h50m35.371441278s) [upload=158214]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:16:13.412351094 (151h50m35.371448362s) [upload=158214]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:16:13.502059552 (151h50m35.461156787s) [upload=158214]: Next segment err: metaclient: Too Many Requests Aug 15 01:16:13.502096202 (151h50m35.461193453s) [upload=158214]: Done uploading segments... Aug 15 01:16:13.502114134 (151h50m35.461211379s) [upload=158214]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.67106504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X...............................X........X.X] duration:
363.986039ms
FAIL (2025-08-15 01:16:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:16:13.411893619 (151h50m35.370990868s) [upload=158214]: Starting upload Aug 15 01:16:13.411947074 (151h50m35.37104432s) [upload=158214]: Done starting upload Aug 15 01:16:13.412160124 (151h50m35.371257383s) [upload=158214]: Uploading segments... Aug 15 01:16:13.412278005 (151h50m35.371375257s) [upload=158214]: Got next segment. Inline: false Aug 15 01:16:13.412344026 (151h50m35.371441278s) [upload=158214]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:16:13.412351094 (151h50m35.371448362s) [upload=158214]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:16:13.502059552 (151h50m35.461156787s) [upload=158214]: Next segment err: metaclient: Too Many Requests Aug 15 01:16:13.502096202 (151h50m35.461193453s) [upload=158214]: Done uploading segments... Aug 15 01:16:13.502114134 (151h50m35.461211379s) [upload=158214]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.012427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X...............X...............] duration:
1.024972646s
FAIL (2025-08-15 01:15:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.025002618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...............................X........X.] duration:
2.523426608s
FAIL (2025-08-15 01:15:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:14:03.012953337 (151h48m24.972050591s) [upload=158178]: Starting upload
Aug 15 01:14:03.013105451 (151h48m24.97220269s) [upload=158178]: Done starting upload
Aug 15 01:14:03.013457638 (151h48m24.972554875s) [upload=158178]: Uploading segments...
Aug 15 01:14:03.013517708 (151h48m24.972614979s) [upload=158178]: Got next segment. Inline: false
Aug 15 01:14:03.013566609 (151h48m24.972663846s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:14:03.013572747 (151h48m24.972669997s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:14:03.211417023 (151h48m25.170514336s) [seg_pos={0 0}, upload=158178]: Begin upload segment...
Aug 15 01:14:03.211491096 (151h48m25.170588334s) [seg_pos={0 0}, upload=158178]: Done begin upload segment.
Aug 15 01:14:03.211555962 (151h48m25.17065321s) [noise=true , address=104.36.82.36:4633 , piece_id=KIYVYXKDZCVXIUO5UT32JBB7AM27ZT2DMM2XYAHKMJDGWKT2CLTQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.212156859 (151h48m25.171254111s) [noise=true , address=104.36.82.38:4720 , piece_id=Y5SXIJS7JSC7OYSJWKCDS7BC5CMLWASS4Q4HAHPZTNNMKV5TB3PA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.212553179 (151h48m25.17165043s) [noise=true , address=77.90.31.17:4788 , piece_id=6LXF7ZYK5WSEBIKKC6X2AEQAGA5GAJBOUM45GKQ5ODXQSCMNQ3QQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.212937434 (151h48m25.172034685s) [noise=true , address=104.36.82.44:4885 , piece_id=S22YPAWGS3WSAKKLADDEHTXS4LWM3AK44D6NWIK4QV3EKCZLGN7Q, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.213351861 (151h48m25.172449111s) [noise=true , address=45.91.116.14:4197 , piece_id=CCIC2EPMWPSCEWZGCEMNQEFGWZOOAFUYSX5P6IIKBZAXYMCYVT5A, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.213751387 (151h48m25.172848644s) [noise=true , address=79.127.220.101:4063 , piece_id=I6K2UVMK5CDDWOHHQJ26NTPXUDKNC4H6IQMACYIRJIXXN6R6V6OQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.214188705 (151h48m25.173285955s) [noise=true , address=104.36.82.4:4826 , piece_id=HJ3EPPFKLUDCQU6SXIPJWKDKUA75IKGB6H4A6YNA6ISU7EY7MFIA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.214593907 (151h48m25.173691157s) [noise=true , address=79.127.201.215:4341 , piece_id=ISQN5TP4GUPLKUI7WD4CXHP6QWFJCX56RQ5YGG4M4BTXC6U42LJA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.215004630 (151h48m25.174101879s) [noise=true , address=64.49.13.26:4950 , piece_id=VNZ7BEBBTEZCZ7C2RFVLOP643LJ7ZIPXYOVMSGJXOE6AKB2DIPRA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.218001802 (151h48m25.17709904s) [noise=true , address=104.36.82.35:4587 , piece_id=DPDYLRZBMNNFL72L252WWFT2JBQIZ75SCS4MTX75DGUSK3FXVRFQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.218506008 (151h48m25.177603256s) [noise=true , address=104.36.82.59:4317 , piece_id=SXRSEZSPVFKLXRKE532NYVXFHAN3W72YGWITVSLRBZPLQRUIILKA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.218881942 (151h48m25.177979191s) [noise=true , address=77.90.31.12:4619 , piece_id=VKJUSQAJ2SJ2LSSNXUGNELR2W6B3PYHOLTGJYWVMKA7HJEAWN6XQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.219249781 (151h48m25.178347032s) [noise=true , address=104.36.82.34:4545 , piece_id=RWB2RI7RH32IPA4L7VHQXRY3N5HFJ2WXB5WVPR5BXINU7GHU67YQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.219639455 (151h48m25.178736706s) [noise=true , address=104.36.82.61:4389 , piece_id=X3OJUAJLUBAIOKYG4IEX5LB2OHW4C366BFGLFPWOLGEUQOSSVNZA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.220021964 (151h48m25.179119213s) [noise=true , address=104.36.82.49:4012 , piece_id=54TCT2WLQP74VHAO2GCI7TNMXLR76W7TD4OYWXNFMI2C4RYDXJTQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.220399213 (151h48m25.179496462s) [noise=true , address=104.36.82.2:4745 , piece_id=MM4C3HSR4HX7OCGRHSY3EI4WI2ZTDKB6UKNVCRVRLOXF6XBB2TQA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.220775178 (151h48m25.17987243s) [noise=true , address=77.90.31.14:4670 , piece_id=KXNYWRZD2J3SBY4OY776KBDAEKKFW6S3LN4SVQNJZHBMSROXFPHQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.221157546 (151h48m25.180254794s) [noise=true , address=104.36.82.9:4010 , piece_id=MCJQTD3KKTIAU4KRFPPGKIXBRSDMQIELKLJIQHMEMXFQKUO6JKWA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.795972638 (151h48m25.755069887s) [upload=158178]: Next returned nil segment
Aug 15 01:14:03.795997656 (151h48m25.755094917s) [upload=158178]: Waiting for error group managing segments...
Aug 15 01:14:03.947715331 (151h48m25.906812578s) [noise=true , address=104.36.82.38:4720 , piece_id=Y5SXIJS7JSC7OYSJWKCDS7BC5CMLWASS4Q4HAHPZTNNMKV5TB3PA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.965837274 (151h48m25.924934523s) [noise=true , address=77.90.31.12:4619 , piece_id=VKJUSQAJ2SJ2LSSNXUGNELR2W6B3PYHOLTGJYWVMKA7HJEAWN6XQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.966532103 (151h48m25.925629343s) [noise=true , address=104.36.82.35:4587 , piece_id=DPDYLRZBMNNFL72L252WWFT2JBQIZ75SCS4MTX75DGUSK3FXVRFQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.976275062 (151h48m25.935372302s) [noise=true , address=104.36.82.59:4317 , piece_id=SXRSEZSPVFKLXRKE532NYVXFHAN3W72YGWITVSLRBZPLQRUIILKA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.981742273 (151h48m25.940839519s) [noise=true , address=77.90.31.14:4670 , piece_id=KXNYWRZD2J3SBY4OY776KBDAEKKFW6S3LN4SVQNJZHBMSROXFPHQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.989088962 (151h48m25.948186211s) [noise=true , address=104.36.82.4:4826 , piece_id=HJ3EPPFKLUDCQU6SXIPJWKDKUA75IKGB6H4A6YNA6ISU7EY7MFIA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.001524974 (151h48m25.960622222s) [noise=true , address=104.36.82.44:4885 , piece_id=S22YPAWGS3WSAKKLADDEHTXS4LWM3AK44D6NWIK4QV3EKCZLGN7Q, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.001584214 (151h48m25.960681487s) [noise=true , address=104.36.82.2:4745 , piece_id=MM4C3HSR4HX7OCGRHSY3EI4WI2ZTDKB6UKNVCRVRLOXF6XBB2TQA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.026940193 (151h48m25.986037445s) [noise=true , address=77.90.31.17:4788 , piece_id=6LXF7ZYK5WSEBIKKC6X2AEQAGA5GAJBOUM45GKQ5ODXQSCMNQ3QQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.034746283 (151h48m25.993843529s) [noise=true , address=104.36.82.49:4012 , piece_id=54TCT2WLQP74VHAO2GCI7TNMXLR76W7TD4OYWXNFMI2C4RYDXJTQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.050470572 (151h48m26.00956782s) [noise=true , address=104.36.82.34:4545 , piece_id=RWB2RI7RH32IPA4L7VHQXRY3N5HFJ2WXB5WVPR5BXINU7GHU67YQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.079156592 (151h48m26.038253824s) [noise=true , address=104.36.82.9:4010 , piece_id=MCJQTD3KKTIAU4KRFPPGKIXBRSDMQIELKLJIQHMEMXFQKUO6JKWA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.099647414 (151h48m26.058744651s) [noise=true , address=45.91.116.14:4197 , piece_id=CCIC2EPMWPSCEWZGCEMNQEFGWZOOAFUYSX5P6IIKBZAXYMCYVT5A, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.128583898 (151h48m26.087681146s) [noise=true , address=104.36.82.36:4633 , piece_id=KIYVYXKDZCVXIUO5UT32JBB7AM27ZT2DMM2XYAHKMJDGWKT2CLTQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.128608682 (151h48m26.08770593s) [seg_pos={0 0}, upload=158178]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:14:04.128909617 (151h48m26.088006871s) [noise=true , address=79.127.220.101:4063 , piece_id=I6K2UVMK5CDDWOHHQJ26NTPXUDKNC4H6IQMACYIRJIXXN6R6V6OQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 15 01:14:04.129014881 (151h48m26.08811213s) [noise=true , address=79.127.201.215:4341 , piece_id=ISQN5TP4GUPLKUI7WD4CXHP6QWFJCX56RQ5YGG4M4BTXC6U42LJA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pvou3YLLA7MA8WAfqjWLRwgwDXWPWZKGGRWYAVBkKCxF5mciG): protocol: expected piece hash; context canceled; EOF
Aug 15 01:14:04.129108675 (151h48m26.088205923s) [noise=true , address=104.36.82.61:4389 , piece_id=X3OJUAJLUBAIOKYG4IEX5LB2OHW4C366BFGLFPWOLGEUQOSSVNZA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF
Aug 15 01:14:04.129224083 (151h48m26.088321332s) [noise=true , address=64.49.13.26:4950 , piece_id=VNZ7BEBBTEZCZ7C2RFVLOP643LJ7ZIPXYOVMSGJXOE6AKB2DIPRA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: write tcp 139.59.144.22:56356->64.49.13.26:4950: use of closed network connection; write tcp 139.59.144.22:56356->64.49.13.26:4950: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56356->64.49.13.26:4950: use of closed network connection
Aug 15 01:14:04.129240496 (151h48m26.088337744s) [seg_pos={0 0}, upload=158178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:14:04.129319366 (151h48m26.088416614s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:14:04.129324296 (151h48m26.088421543s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:14:04.295686839 (151h48m26.254784091s) [upload=158178]: Done uploading segments...
Aug 15 01:14:04.295711310 (151h48m26.254808569s) [upload=158178]: Upload finished. err: <nil>
Duration: 2.523463362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...............X..............] duration:
879.019275ms
FAIL (2025-08-15 01:14:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 879.051895ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...............................X........X] duration:
1.85783104s
FAIL (2025-08-15 01:14:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:14:03.012953337 (151h48m24.972050591s) [upload=158178]: Starting upload
Aug 15 01:14:03.013105451 (151h48m24.97220269s) [upload=158178]: Done starting upload
Aug 15 01:14:03.013457638 (151h48m24.972554875s) [upload=158178]: Uploading segments...
Aug 15 01:14:03.013517708 (151h48m24.972614979s) [upload=158178]: Got next segment. Inline: false
Aug 15 01:14:03.013566609 (151h48m24.972663846s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:14:03.013572747 (151h48m24.972669997s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:14:03.211417023 (151h48m25.170514336s) [seg_pos={0 0}, upload=158178]: Begin upload segment...
Aug 15 01:14:03.211491096 (151h48m25.170588334s) [seg_pos={0 0}, upload=158178]: Done begin upload segment.
Aug 15 01:14:03.211555962 (151h48m25.17065321s) [noise=true , address=104.36.82.36:4633 , piece_id=KIYVYXKDZCVXIUO5UT32JBB7AM27ZT2DMM2XYAHKMJDGWKT2CLTQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.212156859 (151h48m25.171254111s) [noise=true , address=104.36.82.38:4720 , piece_id=Y5SXIJS7JSC7OYSJWKCDS7BC5CMLWASS4Q4HAHPZTNNMKV5TB3PA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.212553179 (151h48m25.17165043s) [noise=true , address=77.90.31.17:4788 , piece_id=6LXF7ZYK5WSEBIKKC6X2AEQAGA5GAJBOUM45GKQ5ODXQSCMNQ3QQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.212937434 (151h48m25.172034685s) [noise=true , address=104.36.82.44:4885 , piece_id=S22YPAWGS3WSAKKLADDEHTXS4LWM3AK44D6NWIK4QV3EKCZLGN7Q, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.213351861 (151h48m25.172449111s) [noise=true , address=45.91.116.14:4197 , piece_id=CCIC2EPMWPSCEWZGCEMNQEFGWZOOAFUYSX5P6IIKBZAXYMCYVT5A, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.213751387 (151h48m25.172848644s) [noise=true , address=79.127.220.101:4063 , piece_id=I6K2UVMK5CDDWOHHQJ26NTPXUDKNC4H6IQMACYIRJIXXN6R6V6OQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.214188705 (151h48m25.173285955s) [noise=true , address=104.36.82.4:4826 , piece_id=HJ3EPPFKLUDCQU6SXIPJWKDKUA75IKGB6H4A6YNA6ISU7EY7MFIA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.214593907 (151h48m25.173691157s) [noise=true , address=79.127.201.215:4341 , piece_id=ISQN5TP4GUPLKUI7WD4CXHP6QWFJCX56RQ5YGG4M4BTXC6U42LJA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.215004630 (151h48m25.174101879s) [noise=true , address=64.49.13.26:4950 , piece_id=VNZ7BEBBTEZCZ7C2RFVLOP643LJ7ZIPXYOVMSGJXOE6AKB2DIPRA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.218001802 (151h48m25.17709904s) [noise=true , address=104.36.82.35:4587 , piece_id=DPDYLRZBMNNFL72L252WWFT2JBQIZ75SCS4MTX75DGUSK3FXVRFQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.218506008 (151h48m25.177603256s) [noise=true , address=104.36.82.59:4317 , piece_id=SXRSEZSPVFKLXRKE532NYVXFHAN3W72YGWITVSLRBZPLQRUIILKA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.218881942 (151h48m25.177979191s) [noise=true , address=77.90.31.12:4619 , piece_id=VKJUSQAJ2SJ2LSSNXUGNELR2W6B3PYHOLTGJYWVMKA7HJEAWN6XQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.219249781 (151h48m25.178347032s) [noise=true , address=104.36.82.34:4545 , piece_id=RWB2RI7RH32IPA4L7VHQXRY3N5HFJ2WXB5WVPR5BXINU7GHU67YQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.219639455 (151h48m25.178736706s) [noise=true , address=104.36.82.61:4389 , piece_id=X3OJUAJLUBAIOKYG4IEX5LB2OHW4C366BFGLFPWOLGEUQOSSVNZA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.220021964 (151h48m25.179119213s) [noise=true , address=104.36.82.49:4012 , piece_id=54TCT2WLQP74VHAO2GCI7TNMXLR76W7TD4OYWXNFMI2C4RYDXJTQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.220399213 (151h48m25.179496462s) [noise=true , address=104.36.82.2:4745 , piece_id=MM4C3HSR4HX7OCGRHSY3EI4WI2ZTDKB6UKNVCRVRLOXF6XBB2TQA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.220775178 (151h48m25.17987243s) [noise=true , address=77.90.31.14:4670 , piece_id=KXNYWRZD2J3SBY4OY776KBDAEKKFW6S3LN4SVQNJZHBMSROXFPHQ, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.221157546 (151h48m25.180254794s) [noise=true , address=104.36.82.9:4010 , piece_id=MCJQTD3KKTIAU4KRFPPGKIXBRSDMQIELKLJIQHMEMXFQKUO6JKWA, seg_pos={0 0}, upload=158178]: Uploading piece...
Aug 15 01:14:03.795972638 (151h48m25.755069887s) [upload=158178]: Next returned nil segment
Aug 15 01:14:03.795997656 (151h48m25.755094917s) [upload=158178]: Waiting for error group managing segments...
Aug 15 01:14:03.947715331 (151h48m25.906812578s) [noise=true , address=104.36.82.38:4720 , piece_id=Y5SXIJS7JSC7OYSJWKCDS7BC5CMLWASS4Q4HAHPZTNNMKV5TB3PA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.965837274 (151h48m25.924934523s) [noise=true , address=77.90.31.12:4619 , piece_id=VKJUSQAJ2SJ2LSSNXUGNELR2W6B3PYHOLTGJYWVMKA7HJEAWN6XQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.966532103 (151h48m25.925629343s) [noise=true , address=104.36.82.35:4587 , piece_id=DPDYLRZBMNNFL72L252WWFT2JBQIZ75SCS4MTX75DGUSK3FXVRFQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.976275062 (151h48m25.935372302s) [noise=true , address=104.36.82.59:4317 , piece_id=SXRSEZSPVFKLXRKE532NYVXFHAN3W72YGWITVSLRBZPLQRUIILKA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.981742273 (151h48m25.940839519s) [noise=true , address=77.90.31.14:4670 , piece_id=KXNYWRZD2J3SBY4OY776KBDAEKKFW6S3LN4SVQNJZHBMSROXFPHQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:03.989088962 (151h48m25.948186211s) [noise=true , address=104.36.82.4:4826 , piece_id=HJ3EPPFKLUDCQU6SXIPJWKDKUA75IKGB6H4A6YNA6ISU7EY7MFIA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.001524974 (151h48m25.960622222s) [noise=true , address=104.36.82.44:4885 , piece_id=S22YPAWGS3WSAKKLADDEHTXS4LWM3AK44D6NWIK4QV3EKCZLGN7Q, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.001584214 (151h48m25.960681487s) [noise=true , address=104.36.82.2:4745 , piece_id=MM4C3HSR4HX7OCGRHSY3EI4WI2ZTDKB6UKNVCRVRLOXF6XBB2TQA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.026940193 (151h48m25.986037445s) [noise=true , address=77.90.31.17:4788 , piece_id=6LXF7ZYK5WSEBIKKC6X2AEQAGA5GAJBOUM45GKQ5ODXQSCMNQ3QQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.034746283 (151h48m25.993843529s) [noise=true , address=104.36.82.49:4012 , piece_id=54TCT2WLQP74VHAO2GCI7TNMXLR76W7TD4OYWXNFMI2C4RYDXJTQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.050470572 (151h48m26.00956782s) [noise=true , address=104.36.82.34:4545 , piece_id=RWB2RI7RH32IPA4L7VHQXRY3N5HFJ2WXB5WVPR5BXINU7GHU67YQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.079156592 (151h48m26.038253824s) [noise=true , address=104.36.82.9:4010 , piece_id=MCJQTD3KKTIAU4KRFPPGKIXBRSDMQIELKLJIQHMEMXFQKUO6JKWA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.099647414 (151h48m26.058744651s) [noise=true , address=45.91.116.14:4197 , piece_id=CCIC2EPMWPSCEWZGCEMNQEFGWZOOAFUYSX5P6IIKBZAXYMCYVT5A, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.128583898 (151h48m26.087681146s) [noise=true , address=104.36.82.36:4633 , piece_id=KIYVYXKDZCVXIUO5UT32JBB7AM27ZT2DMM2XYAHKMJDGWKT2CLTQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: <nil>
Aug 15 01:14:04.128608682 (151h48m26.08770593s) [seg_pos={0 0}, upload=158178]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:14:04.128909617 (151h48m26.088006871s) [noise=true , address=79.127.220.101:4063 , piece_id=I6K2UVMK5CDDWOHHQJ26NTPXUDKNC4H6IQMACYIRJIXXN6R6V6OQ, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 15 01:14:04.129014881 (151h48m26.08811213s) [noise=true , address=79.127.201.215:4341 , piece_id=ISQN5TP4GUPLKUI7WD4CXHP6QWFJCX56RQ5YGG4M4BTXC6U42LJA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pvou3YLLA7MA8WAfqjWLRwgwDXWPWZKGGRWYAVBkKCxF5mciG): protocol: expected piece hash; context canceled; EOF
Aug 15 01:14:04.129108675 (151h48m26.088205923s) [noise=true , address=104.36.82.61:4389 , piece_id=X3OJUAJLUBAIOKYG4IEX5LB2OHW4C366BFGLFPWOLGEUQOSSVNZA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF
Aug 15 01:14:04.129224083 (151h48m26.088321332s) [noise=true , address=64.49.13.26:4950 , piece_id=VNZ7BEBBTEZCZ7C2RFVLOP643LJ7ZIPXYOVMSGJXOE6AKB2DIPRA, seg_pos={0 0}, upload=158178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Tv25fLSqTnZQiDzrYqKCSbdt6ep3upgqD2Se8QSRuQFynkSN): protocol: write tcp 139.59.144.22:56356->64.49.13.26:4950: use of closed network connection; write tcp 139.59.144.22:56356->64.49.13.26:4950: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56356->64.49.13.26:4950: use of closed network connection
Aug 15 01:14:04.129240496 (151h48m26.088337744s) [seg_pos={0 0}, upload=158178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:14:04.129319366 (151h48m26.088416614s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:14:04.129324296 (151h48m26.088421543s) [upload=158178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:14:04.295686839 (151h48m26.254784091s) [upload=158178]: Done uploading segments...
Aug 15 01:14:04.295711310 (151h48m26.254808569s) [upload=158178]: Upload finished. err: <nil>
Duration: 1.857869004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...............X.............] duration:
845.291482ms
FAIL (2025-08-15 01:13:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 845.329467ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...............X............] duration:
858.492445ms
FAIL (2025-08-15 01:13:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 858.59671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...............................X........] duration:
2.416758509s
FAIL (2025-08-15 01:13:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.416800503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...............................X.......] duration:
2.611574056s
FAIL (2025-08-15 01:12:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.611611782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X...............X...........] duration:
1.013052979s
FAIL (2025-08-15 01:12:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.013101219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...............X..........] duration:
1.048626998s
FAIL (2025-08-15 01:11:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.048668385s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...............................X......] duration:
2.609471868s
FAIL (2025-08-15 01:11:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.609507193s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...............................X.....] duration:
2.37829238s
FAIL (2025-08-15 01:11:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.378334103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...............X.........] duration:
902.321854ms
FAIL (2025-08-15 01:11:16 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 902.357847ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration:
2.512985262s
FAIL (2025-08-15 01:11:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.513017816s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...............X........] duration:
878.719223ms
FAIL (2025-08-15 01:10:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 878.830876ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...............X.......] duration:
850.111166ms
FAIL (2025-08-15 01:10:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 850.162514ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...............................X...] duration:
2.437810792s
FAIL (2025-08-15 01:10:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.437940892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...............X......] duration:
827.851844ms
FAIL (2025-08-15 01:09:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 827.883796ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...............................X..] duration:
2.578078431s
FAIL (2025-08-15 01:09:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.578127431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...............X.....] duration:
1.053229938s
FAIL (2025-08-15 01:08:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.053262778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...............................X.] duration:
2.578379407s
FAIL (2025-08-15 01:08:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.578477893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...............................X] duration:
366.416934ms
FAIL (2025-08-15 01:08:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:08:03.903376887 (151h42m25.862474142s) [upload=158071]: Starting upload Aug 15 01:08:03.903465520 (151h42m25.862562768s) [upload=158071]: Done starting upload Aug 15 01:08:03.903603389 (151h42m25.862700622s) [upload=158071]: Uploading segments... Aug 15 01:08:03.904128861 (151h42m25.863226176s) [upload=158071]: Got next segment. Inline: false Aug 15 01:08:03.904224634 (151h42m25.86332188s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:08:03.904231881 (151h42m25.863329133s) [upload=158071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:08:03.995799006 (151h42m25.954896255s) [upload=158071]: Next segment err: metaclient: Too Many Requests Aug 15 01:08:03.995823738 (151h42m25.954920974s) [upload=158071]: Done uploading segments... Aug 15 01:08:03.995840593 (151h42m25.954937829s) [upload=158071]: Upload finished. err: metaclient: Too Many Requests
Duration: 366.446057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...............X....] duration:
849.860416ms
FAIL (2025-08-15 01:07:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 849.889078ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.541761749s
FAIL (2025-08-15 01:07:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.541793159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X...............X...] duration:
1.12708116s
FAIL (2025-08-15 01:07:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.127112356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.546264463s
FAIL (2025-08-15 01:06:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.5462944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X...............X..] duration:
914.142553ms
FAIL (2025-08-15 01:06:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 914.235453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.513869243s
FAIL (2025-08-15 01:06:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.513900306s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.575660844s
FAIL (2025-08-15 01:05:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.575695465s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X...............X.] duration:
818.18122ms
FAIL (2025-08-15 01:05:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 818.226966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...............................X...........................] duration:
2.392073558s
FAIL (2025-08-15 01:05:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.39210329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X...............X] duration:
1.177585779s
FAIL (2025-08-15 01:04:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.177613355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...............................X..........................] duration:
2.482044017s
FAIL (2025-08-15 01:04:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.482076852s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...............................X.........................] duration:
2.732049021s
FAIL (2025-08-15 01:04:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.732079286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.074629946s
FAIL (2025-08-15 01:03:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 1.074727554s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...............................X........................] duration:
2.512048544s
FAIL (2025-08-15 01:03:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.512086807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
933.833793ms
FAIL (2025-08-15 01:03:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 933.866363ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...............................X.......................] duration:
2.682471878s
FAIL (2025-08-15 01:02:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.68251317s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.012057396s
FAIL (2025-08-15 01:02:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 1.012096784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................X......................] duration:
2.739557581s
FAIL (2025-08-15 01:02:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.739589732s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.095161033s
FAIL (2025-08-15 01:02:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 1.095197736s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.203724409s
FAIL (2025-08-15 01:01:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 1.203791764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................X.....................] duration:
3.364787958s
FAIL (2025-08-15 01:01:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.364829834s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.029399626s
FAIL (2025-08-15 01:00:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 1.029436006s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X......X...............................X....................] duration:
2.796650224s
FAIL (2025-08-15 01:00:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.796701246s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
942.532436ms
FAIL (2025-08-15 01:00:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 00:53:32.554585143 (151h27m54.513682381s) [upload=157820]: Starting upload Aug 15 00:53:32.554659690 (151h27m54.513756936s) [upload=157820]: Done starting upload Aug 15 00:53:32.554743977 (151h27m54.513841214s) [upload=157820]: Uploading segments... Aug 15 00:53:32.554828345 (151h27m54.51392558s) [upload=157820]: Got next segment. Inline: true Aug 15 00:53:32.554835061 (151h27m54.513932307s) [upload=157820]: Waiting for error group managing segments... Aug 15 00:53:32.554911458 (151h27m54.51400869s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:53:32.554917778 (151h27m54.514015074s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 00:53:32.554921804 (151h27m54.514019051s) [upload=157820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 00:53:34.565891478 (151h27m56.524988714s) [upload=157820]: Done uploading segments... Aug 15 00:53:34.565937036 (151h27m56.525034271s) [upload=157820]: Upload finished. err: <nil>
Duration: 942.585949ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X......X...............................X...................] duration:
2.651275425s
FAIL (2025-08-15 00:59:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 00:46:14.836145409 (151h20m36.795242656s) [upload=157695]: Starting upload Aug 15 00:46:14.836236164 (151h20m36.795333413s) [upload=157695]: Done starting upload Aug 15 00:46:14.836400039 (151h20m36.795497291s) [upload=157695]: Uploading segments... Aug 15 00:46:14.837149725 (151h20m36.796246982s) [upload=157695]: Got next segment. Inline: false Aug 15 00:46:14.837261663 (151h20m36.796358919s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 00:46:14.837270357 (151h20m36.796367619s) [upload=157695]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 00:46:14.925467294 (151h20m36.884564548s) [upload=157695]: Next segment err: metaclient: Too Many Requests Aug 15 00:46:14.925495946 (151h20m36.884593203s) [upload=157695]: Done uploading segments... Aug 15 00:46:14.925515418 (151h20m36.884612666s) [upload=157695]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.65130752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|