Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.....................................X..] duration:
3.228120565s
FAIL (2025-08-10 01:03:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 01:01:47.834624881 (31h36m9.793722134s) [upload=32933]: Starting upload
Aug 10 01:01:47.834705076 (31h36m9.793802316s) [upload=32933]: Done starting upload
Aug 10 01:01:47.834861826 (31h36m9.793959076s) [upload=32933]: Uploading segments...
Aug 10 01:01:47.835027102 (31h36m9.794124348s) [upload=32933]: Got next segment. Inline: false
Aug 10 01:01:47.835084255 (31h36m9.794181493s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 01:01:47.835089947 (31h36m9.794187193s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 01:01:48.030708597 (31h36m9.989805877s) [seg_pos={0 0}, upload=32933]: Begin upload segment...
Aug 10 01:01:48.030773995 (31h36m9.989871227s) [seg_pos={0 0}, upload=32933]: Done begin upload segment.
Aug 10 01:01:48.030798679 (31h36m9.989895924s) [noise=true , address=104.36.82.54:4174 , piece_id=OKY3CRB4VKH5V3W6B4R5BC6ZIOMHN3BVQIT5ERBDUMAHFMMUFCXA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031203168 (31h36m9.990300412s) [noise=true , address=104.36.82.17:4331 , piece_id=VL6YLWAW4KIPPUGE53Q4XPMKN77VV4J67UOMWMXFI3FONEEQFRHA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031446471 (31h36m9.99054372s) [noise=true , address=104.36.82.38:4693 , piece_id=JHBJNV6ELU3NLEXZG74TTHXW3O7T37NOH2UZDSMZKYRYVPVST4FQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031541305 (31h36m9.990638557s) [noise=true , address=104.36.82.2:4760 , piece_id=LEEKMSCAHRLIX4IQTB4IETMUVRCYY7MQMNLUQQJSG2NKW46NIIUA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032237975 (31h36m9.991335214s) [noise=true , address=104.36.82.61:4393 , piece_id=3GMJBIU35JREP7GZRXNRRMVO3PWITXRG2RNZBBL6KLG4LK53JZRQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032313198 (31h36m9.991410446s) [noise=true , address=104.36.82.5:4860 , piece_id=QUGJIRTXMWSI5HELKXKLFQ376BDKAFJE53KFCSLXHMKBCFHGGBCQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032809438 (31h36m9.99190669s) [noise=true , address=104.36.82.44:4871 , piece_id=VHL2LZPJGOYZ5FHM65N5IPXVKBHFOYIYN4R63HMUPOYC7UJ4EDTA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032848717 (31h36m9.991945965s) [noise=true , address=104.36.82.46:4487 , piece_id=IOUPCT5OFOHLIVVEFU4WSLFBQTQ3FL4E2E6EG2JYSCTVQUBTXE5Q, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.033323109 (31h36m9.992420357s) [noise=true , address=104.36.82.62:4438 , piece_id=X7HZVL5W4JD7HDOWDA4JLWEDCTZYWCDXIY3V4YM6T5VQTB6YV7CA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.033867566 (31h36m9.992964811s) [noise=true , address=104.36.82.37:4659 , piece_id=YUIUMKWNC35DYK6PH2TRCMSTLQJKAFS6MZPEPODKA5NRNIQFKBFQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.034745605 (31h36m9.99384286s) [noise=true , address=104.36.82.58:4272 , piece_id=QYBKISCC2SAUNAPDQAVXHBGEZQ7VSAHRRJSSCEEQQY3YVTTEG73Q, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.037241681 (31h36m9.996338935s) [noise=true , address=45.91.116.6:4994 , piece_id=2MGQEM6AYMYS3TFICH372XAJ5KDFWWLVZ5WZ3GBN52FAPEZ7AWOQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.039976686 (31h36m9.99907394s) [noise=true , address=104.36.82.37:4661 , piece_id=UMBOP6O2SRWJTCHIM5JBIFQQYZH5F4ABH2MSXBZD4TTH3DGFQ6WQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.045472065 (31h36m10.004569319s) [noise=true , address=104.36.82.35:4586 , piece_id=6RWAJIEFGIB7TMGFZ7SYGKNXTYDE4XBRYNNV3GSZUI2GRFGHQKKQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.047730206 (31h36m10.006827461s) [noise=true , address=104.36.82.45:4919 , piece_id=A35SHXW747WAV4FEZ5FKXLTAI2EW6UWEAIBH3LIUJFKSBC5FZOAQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.047842375 (31h36m10.00693962s) [noise=true , address=104.36.82.43:4852 , piece_id=PXRNCUGJHKRWQWBMWDTR43Y2FWMTW64IU7JV5WR3VVGMM7HAY4SA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.048261164 (31h36m10.007358412s) [noise=true , address=104.36.82.6:4891 , piece_id=SXZSJEHR5QSAIJJ7BNQNT7G227TEEAKPHVBDT4ONU5UV32KUI6EQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.052039401 (31h36m10.011136669s) [noise=true , address=64.49.13.169:4715 , piece_id=O5M4VMD3KAL42HHFCPZWFFBLR3ZYTYOO3YTT2LS4ZKHG7V7PXAPQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.597402725 (31h36m10.556499962s) [upload=32933]: Next returned nil segment
Aug 10 01:01:48.597431770 (31h36m10.556529016s) [upload=32933]: Waiting for error group managing segments...
Aug 10 01:01:48.752014349 (31h36m10.711111586s) [noise=true , address=45.91.116.6:4994 , piece_id=2MGQEM6AYMYS3TFICH372XAJ5KDFWWLVZ5WZ3GBN52FAPEZ7AWOQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.764183504 (31h36m10.723280743s) [noise=true , address=104.36.82.62:4438 , piece_id=X7HZVL5W4JD7HDOWDA4JLWEDCTZYWCDXIY3V4YM6T5VQTB6YV7CA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.767499536 (31h36m10.726596776s) [noise=true , address=104.36.82.61:4393 , piece_id=3GMJBIU35JREP7GZRXNRRMVO3PWITXRG2RNZBBL6KLG4LK53JZRQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.768206250 (31h36m10.727303488s) [noise=true , address=104.36.82.17:4331 , piece_id=VL6YLWAW4KIPPUGE53Q4XPMKN77VV4J67UOMWMXFI3FONEEQFRHA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.784717295 (31h36m10.743814542s) [noise=true , address=104.36.82.45:4919 , piece_id=A35SHXW747WAV4FEZ5FKXLTAI2EW6UWEAIBH3LIUJFKSBC5FZOAQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.790389630 (31h36m10.74948687s) [noise=true , address=104.36.82.54:4174 , piece_id=OKY3CRB4VKH5V3W6B4R5BC6ZIOMHN3BVQIT5ERBDUMAHFMMUFCXA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.795737433 (31h36m10.754834668s) [noise=true , address=104.36.82.46:4487 , piece_id=IOUPCT5OFOHLIVVEFU4WSLFBQTQ3FL4E2E6EG2JYSCTVQUBTXE5Q, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.811496313 (31h36m10.770593551s) [noise=true , address=104.36.82.35:4586 , piece_id=6RWAJIEFGIB7TMGFZ7SYGKNXTYDE4XBRYNNV3GSZUI2GRFGHQKKQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.876016153 (31h36m10.835113385s) [noise=true , address=104.36.82.2:4760 , piece_id=LEEKMSCAHRLIX4IQTB4IETMUVRCYY7MQMNLUQQJSG2NKW46NIIUA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.128668981 (31h36m11.087766214s) [noise=true , address=104.36.82.38:4693 , piece_id=JHBJNV6ELU3NLEXZG74TTHXW3O7T37NOH2UZDSMZKYRYVPVST4FQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.286993508 (31h36m11.246090759s) [noise=true , address=104.36.82.6:4891 , piece_id=SXZSJEHR5QSAIJJ7BNQNT7G227TEEAKPHVBDT4ONU5UV32KUI6EQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.297448118 (31h36m11.256545354s) [noise=true , address=64.49.13.169:4715 , piece_id=O5M4VMD3KAL42HHFCPZWFFBLR3ZYTYOO3YTT2LS4ZKHG7V7PXAPQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.335344988 (31h36m11.294442225s) [noise=true , address=104.36.82.37:4659 , piece_id=YUIUMKWNC35DYK6PH2TRCMSTLQJKAFS6MZPEPODKA5NRNIQFKBFQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.385790523 (31h36m11.344887765s) [noise=true , address=104.36.82.58:4272 , piece_id=QYBKISCC2SAUNAPDQAVXHBGEZQ7VSAHRRJSSCEEQQY3YVTTEG73Q, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.385817561 (31h36m11.344914804s) [seg_pos={0 0}, upload=32933]: Segment reached optimal threshold of 14 pieces.
Aug 10 01:01:49.385995679 (31h36m11.345092918s) [noise=true , address=104.36.82.44:4871 , piece_id=VHL2LZPJGOYZ5FHM65N5IPXVKBHFOYIYN4R63HMUPOYC7UJ4EDTA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 10 01:01:49.386398550 (31h36m11.345495786s) [noise=true , address=104.36.82.37:4661 , piece_id=UMBOP6O2SRWJTCHIM5JBIFQQYZH5F4ABH2MSXBZD4TTH3DGFQ6WQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jxHbnubVkjisrfmNbLTpYRbBpr5jEyJSMSVUcj57pb1sCrG4i): protocol: expected piece hash; context canceled; EOF
Aug 10 01:01:49.386572706 (31h36m11.345669943s) [noise=true , address=104.36.82.43:4852 , piece_id=PXRNCUGJHKRWQWBMWDTR43Y2FWMTW64IU7JV5WR3VVGMM7HAY4SA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CWXaz1RJdY28Y4jCshs5Ti4GhJKR1LJL1pBBEWGWrzbfZXfav): protocol: write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection; write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection
Aug 10 01:01:49.386673261 (31h36m11.345770499s) [noise=true , address=104.36.82.5:4860 , piece_id=QUGJIRTXMWSI5HELKXKLFQ376BDKAFJE53KFCSLXHMKBCFHGGBCQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 139.59.144.22:58874->104.36.82.5:4860: use of closed network connection; write tcp 139.59.144.22:58874->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: context canceled
Aug 10 01:01:49.386696877 (31h36m11.345794115s) [seg_pos={0 0}, upload=32933]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 01:01:49.386798157 (31h36m11.345895403s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 01:01:49.386804000 (31h36m11.345901246s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 01:01:49.547584102 (31h36m11.506681348s) [upload=32933]: Done uploading segments...
Aug 10 01:01:49.547691617 (31h36m11.506788856s) [upload=32933]: Upload finished. err: <nil>
Duration: 3.228165825s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.004262939s
FAIL (2025-08-10 01:03:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 1.004320239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.....................................X.] duration:
2.868979454s
FAIL (2025-08-10 01:02:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 01:01:47.834624881 (31h36m9.793722134s) [upload=32933]: Starting upload
Aug 10 01:01:47.834705076 (31h36m9.793802316s) [upload=32933]: Done starting upload
Aug 10 01:01:47.834861826 (31h36m9.793959076s) [upload=32933]: Uploading segments...
Aug 10 01:01:47.835027102 (31h36m9.794124348s) [upload=32933]: Got next segment. Inline: false
Aug 10 01:01:47.835084255 (31h36m9.794181493s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 01:01:47.835089947 (31h36m9.794187193s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 01:01:48.030708597 (31h36m9.989805877s) [seg_pos={0 0}, upload=32933]: Begin upload segment...
Aug 10 01:01:48.030773995 (31h36m9.989871227s) [seg_pos={0 0}, upload=32933]: Done begin upload segment.
Aug 10 01:01:48.030798679 (31h36m9.989895924s) [noise=true , address=104.36.82.54:4174 , piece_id=OKY3CRB4VKH5V3W6B4R5BC6ZIOMHN3BVQIT5ERBDUMAHFMMUFCXA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031203168 (31h36m9.990300412s) [noise=true , address=104.36.82.17:4331 , piece_id=VL6YLWAW4KIPPUGE53Q4XPMKN77VV4J67UOMWMXFI3FONEEQFRHA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031446471 (31h36m9.99054372s) [noise=true , address=104.36.82.38:4693 , piece_id=JHBJNV6ELU3NLEXZG74TTHXW3O7T37NOH2UZDSMZKYRYVPVST4FQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031541305 (31h36m9.990638557s) [noise=true , address=104.36.82.2:4760 , piece_id=LEEKMSCAHRLIX4IQTB4IETMUVRCYY7MQMNLUQQJSG2NKW46NIIUA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032237975 (31h36m9.991335214s) [noise=true , address=104.36.82.61:4393 , piece_id=3GMJBIU35JREP7GZRXNRRMVO3PWITXRG2RNZBBL6KLG4LK53JZRQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032313198 (31h36m9.991410446s) [noise=true , address=104.36.82.5:4860 , piece_id=QUGJIRTXMWSI5HELKXKLFQ376BDKAFJE53KFCSLXHMKBCFHGGBCQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032809438 (31h36m9.99190669s) [noise=true , address=104.36.82.44:4871 , piece_id=VHL2LZPJGOYZ5FHM65N5IPXVKBHFOYIYN4R63HMUPOYC7UJ4EDTA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032848717 (31h36m9.991945965s) [noise=true , address=104.36.82.46:4487 , piece_id=IOUPCT5OFOHLIVVEFU4WSLFBQTQ3FL4E2E6EG2JYSCTVQUBTXE5Q, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.033323109 (31h36m9.992420357s) [noise=true , address=104.36.82.62:4438 , piece_id=X7HZVL5W4JD7HDOWDA4JLWEDCTZYWCDXIY3V4YM6T5VQTB6YV7CA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.033867566 (31h36m9.992964811s) [noise=true , address=104.36.82.37:4659 , piece_id=YUIUMKWNC35DYK6PH2TRCMSTLQJKAFS6MZPEPODKA5NRNIQFKBFQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.034745605 (31h36m9.99384286s) [noise=true , address=104.36.82.58:4272 , piece_id=QYBKISCC2SAUNAPDQAVXHBGEZQ7VSAHRRJSSCEEQQY3YVTTEG73Q, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.037241681 (31h36m9.996338935s) [noise=true , address=45.91.116.6:4994 , piece_id=2MGQEM6AYMYS3TFICH372XAJ5KDFWWLVZ5WZ3GBN52FAPEZ7AWOQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.039976686 (31h36m9.99907394s) [noise=true , address=104.36.82.37:4661 , piece_id=UMBOP6O2SRWJTCHIM5JBIFQQYZH5F4ABH2MSXBZD4TTH3DGFQ6WQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.045472065 (31h36m10.004569319s) [noise=true , address=104.36.82.35:4586 , piece_id=6RWAJIEFGIB7TMGFZ7SYGKNXTYDE4XBRYNNV3GSZUI2GRFGHQKKQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.047730206 (31h36m10.006827461s) [noise=true , address=104.36.82.45:4919 , piece_id=A35SHXW747WAV4FEZ5FKXLTAI2EW6UWEAIBH3LIUJFKSBC5FZOAQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.047842375 (31h36m10.00693962s) [noise=true , address=104.36.82.43:4852 , piece_id=PXRNCUGJHKRWQWBMWDTR43Y2FWMTW64IU7JV5WR3VVGMM7HAY4SA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.048261164 (31h36m10.007358412s) [noise=true , address=104.36.82.6:4891 , piece_id=SXZSJEHR5QSAIJJ7BNQNT7G227TEEAKPHVBDT4ONU5UV32KUI6EQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.052039401 (31h36m10.011136669s) [noise=true , address=64.49.13.169:4715 , piece_id=O5M4VMD3KAL42HHFCPZWFFBLR3ZYTYOO3YTT2LS4ZKHG7V7PXAPQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.597402725 (31h36m10.556499962s) [upload=32933]: Next returned nil segment
Aug 10 01:01:48.597431770 (31h36m10.556529016s) [upload=32933]: Waiting for error group managing segments...
Aug 10 01:01:48.752014349 (31h36m10.711111586s) [noise=true , address=45.91.116.6:4994 , piece_id=2MGQEM6AYMYS3TFICH372XAJ5KDFWWLVZ5WZ3GBN52FAPEZ7AWOQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.764183504 (31h36m10.723280743s) [noise=true , address=104.36.82.62:4438 , piece_id=X7HZVL5W4JD7HDOWDA4JLWEDCTZYWCDXIY3V4YM6T5VQTB6YV7CA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.767499536 (31h36m10.726596776s) [noise=true , address=104.36.82.61:4393 , piece_id=3GMJBIU35JREP7GZRXNRRMVO3PWITXRG2RNZBBL6KLG4LK53JZRQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.768206250 (31h36m10.727303488s) [noise=true , address=104.36.82.17:4331 , piece_id=VL6YLWAW4KIPPUGE53Q4XPMKN77VV4J67UOMWMXFI3FONEEQFRHA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.784717295 (31h36m10.743814542s) [noise=true , address=104.36.82.45:4919 , piece_id=A35SHXW747WAV4FEZ5FKXLTAI2EW6UWEAIBH3LIUJFKSBC5FZOAQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.790389630 (31h36m10.74948687s) [noise=true , address=104.36.82.54:4174 , piece_id=OKY3CRB4VKH5V3W6B4R5BC6ZIOMHN3BVQIT5ERBDUMAHFMMUFCXA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.795737433 (31h36m10.754834668s) [noise=true , address=104.36.82.46:4487 , piece_id=IOUPCT5OFOHLIVVEFU4WSLFBQTQ3FL4E2E6EG2JYSCTVQUBTXE5Q, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.811496313 (31h36m10.770593551s) [noise=true , address=104.36.82.35:4586 , piece_id=6RWAJIEFGIB7TMGFZ7SYGKNXTYDE4XBRYNNV3GSZUI2GRFGHQKKQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.876016153 (31h36m10.835113385s) [noise=true , address=104.36.82.2:4760 , piece_id=LEEKMSCAHRLIX4IQTB4IETMUVRCYY7MQMNLUQQJSG2NKW46NIIUA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.128668981 (31h36m11.087766214s) [noise=true , address=104.36.82.38:4693 , piece_id=JHBJNV6ELU3NLEXZG74TTHXW3O7T37NOH2UZDSMZKYRYVPVST4FQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.286993508 (31h36m11.246090759s) [noise=true , address=104.36.82.6:4891 , piece_id=SXZSJEHR5QSAIJJ7BNQNT7G227TEEAKPHVBDT4ONU5UV32KUI6EQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.297448118 (31h36m11.256545354s) [noise=true , address=64.49.13.169:4715 , piece_id=O5M4VMD3KAL42HHFCPZWFFBLR3ZYTYOO3YTT2LS4ZKHG7V7PXAPQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.335344988 (31h36m11.294442225s) [noise=true , address=104.36.82.37:4659 , piece_id=YUIUMKWNC35DYK6PH2TRCMSTLQJKAFS6MZPEPODKA5NRNIQFKBFQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.385790523 (31h36m11.344887765s) [noise=true , address=104.36.82.58:4272 , piece_id=QYBKISCC2SAUNAPDQAVXHBGEZQ7VSAHRRJSSCEEQQY3YVTTEG73Q, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.385817561 (31h36m11.344914804s) [seg_pos={0 0}, upload=32933]: Segment reached optimal threshold of 14 pieces.
Aug 10 01:01:49.385995679 (31h36m11.345092918s) [noise=true , address=104.36.82.44:4871 , piece_id=VHL2LZPJGOYZ5FHM65N5IPXVKBHFOYIYN4R63HMUPOYC7UJ4EDTA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 10 01:01:49.386398550 (31h36m11.345495786s) [noise=true , address=104.36.82.37:4661 , piece_id=UMBOP6O2SRWJTCHIM5JBIFQQYZH5F4ABH2MSXBZD4TTH3DGFQ6WQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jxHbnubVkjisrfmNbLTpYRbBpr5jEyJSMSVUcj57pb1sCrG4i): protocol: expected piece hash; context canceled; EOF
Aug 10 01:01:49.386572706 (31h36m11.345669943s) [noise=true , address=104.36.82.43:4852 , piece_id=PXRNCUGJHKRWQWBMWDTR43Y2FWMTW64IU7JV5WR3VVGMM7HAY4SA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CWXaz1RJdY28Y4jCshs5Ti4GhJKR1LJL1pBBEWGWrzbfZXfav): protocol: write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection; write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection
Aug 10 01:01:49.386673261 (31h36m11.345770499s) [noise=true , address=104.36.82.5:4860 , piece_id=QUGJIRTXMWSI5HELKXKLFQ376BDKAFJE53KFCSLXHMKBCFHGGBCQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 139.59.144.22:58874->104.36.82.5:4860: use of closed network connection; write tcp 139.59.144.22:58874->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: context canceled
Aug 10 01:01:49.386696877 (31h36m11.345794115s) [seg_pos={0 0}, upload=32933]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 01:01:49.386798157 (31h36m11.345895403s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 01:01:49.386804000 (31h36m11.345901246s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 01:01:49.547584102 (31h36m11.506681348s) [upload=32933]: Done uploading segments...
Aug 10 01:01:49.547691617 (31h36m11.506788856s) [upload=32933]: Upload finished. err: <nil>
Duration: 2.869019567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
857.559313ms
FAIL (2025-08-10 01:02:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 857.595498ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.....................................X] duration:
2.289523956s
FAIL (2025-08-10 01:01:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 01:01:47.834624881 (31h36m9.793722134s) [upload=32933]: Starting upload
Aug 10 01:01:47.834705076 (31h36m9.793802316s) [upload=32933]: Done starting upload
Aug 10 01:01:47.834861826 (31h36m9.793959076s) [upload=32933]: Uploading segments...
Aug 10 01:01:47.835027102 (31h36m9.794124348s) [upload=32933]: Got next segment. Inline: false
Aug 10 01:01:47.835084255 (31h36m9.794181493s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 01:01:47.835089947 (31h36m9.794187193s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 01:01:48.030708597 (31h36m9.989805877s) [seg_pos={0 0}, upload=32933]: Begin upload segment...
Aug 10 01:01:48.030773995 (31h36m9.989871227s) [seg_pos={0 0}, upload=32933]: Done begin upload segment.
Aug 10 01:01:48.030798679 (31h36m9.989895924s) [noise=true , address=104.36.82.54:4174 , piece_id=OKY3CRB4VKH5V3W6B4R5BC6ZIOMHN3BVQIT5ERBDUMAHFMMUFCXA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031203168 (31h36m9.990300412s) [noise=true , address=104.36.82.17:4331 , piece_id=VL6YLWAW4KIPPUGE53Q4XPMKN77VV4J67UOMWMXFI3FONEEQFRHA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031446471 (31h36m9.99054372s) [noise=true , address=104.36.82.38:4693 , piece_id=JHBJNV6ELU3NLEXZG74TTHXW3O7T37NOH2UZDSMZKYRYVPVST4FQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.031541305 (31h36m9.990638557s) [noise=true , address=104.36.82.2:4760 , piece_id=LEEKMSCAHRLIX4IQTB4IETMUVRCYY7MQMNLUQQJSG2NKW46NIIUA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032237975 (31h36m9.991335214s) [noise=true , address=104.36.82.61:4393 , piece_id=3GMJBIU35JREP7GZRXNRRMVO3PWITXRG2RNZBBL6KLG4LK53JZRQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032313198 (31h36m9.991410446s) [noise=true , address=104.36.82.5:4860 , piece_id=QUGJIRTXMWSI5HELKXKLFQ376BDKAFJE53KFCSLXHMKBCFHGGBCQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032809438 (31h36m9.99190669s) [noise=true , address=104.36.82.44:4871 , piece_id=VHL2LZPJGOYZ5FHM65N5IPXVKBHFOYIYN4R63HMUPOYC7UJ4EDTA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.032848717 (31h36m9.991945965s) [noise=true , address=104.36.82.46:4487 , piece_id=IOUPCT5OFOHLIVVEFU4WSLFBQTQ3FL4E2E6EG2JYSCTVQUBTXE5Q, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.033323109 (31h36m9.992420357s) [noise=true , address=104.36.82.62:4438 , piece_id=X7HZVL5W4JD7HDOWDA4JLWEDCTZYWCDXIY3V4YM6T5VQTB6YV7CA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.033867566 (31h36m9.992964811s) [noise=true , address=104.36.82.37:4659 , piece_id=YUIUMKWNC35DYK6PH2TRCMSTLQJKAFS6MZPEPODKA5NRNIQFKBFQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.034745605 (31h36m9.99384286s) [noise=true , address=104.36.82.58:4272 , piece_id=QYBKISCC2SAUNAPDQAVXHBGEZQ7VSAHRRJSSCEEQQY3YVTTEG73Q, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.037241681 (31h36m9.996338935s) [noise=true , address=45.91.116.6:4994 , piece_id=2MGQEM6AYMYS3TFICH372XAJ5KDFWWLVZ5WZ3GBN52FAPEZ7AWOQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.039976686 (31h36m9.99907394s) [noise=true , address=104.36.82.37:4661 , piece_id=UMBOP6O2SRWJTCHIM5JBIFQQYZH5F4ABH2MSXBZD4TTH3DGFQ6WQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.045472065 (31h36m10.004569319s) [noise=true , address=104.36.82.35:4586 , piece_id=6RWAJIEFGIB7TMGFZ7SYGKNXTYDE4XBRYNNV3GSZUI2GRFGHQKKQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.047730206 (31h36m10.006827461s) [noise=true , address=104.36.82.45:4919 , piece_id=A35SHXW747WAV4FEZ5FKXLTAI2EW6UWEAIBH3LIUJFKSBC5FZOAQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.047842375 (31h36m10.00693962s) [noise=true , address=104.36.82.43:4852 , piece_id=PXRNCUGJHKRWQWBMWDTR43Y2FWMTW64IU7JV5WR3VVGMM7HAY4SA, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.048261164 (31h36m10.007358412s) [noise=true , address=104.36.82.6:4891 , piece_id=SXZSJEHR5QSAIJJ7BNQNT7G227TEEAKPHVBDT4ONU5UV32KUI6EQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.052039401 (31h36m10.011136669s) [noise=true , address=64.49.13.169:4715 , piece_id=O5M4VMD3KAL42HHFCPZWFFBLR3ZYTYOO3YTT2LS4ZKHG7V7PXAPQ, seg_pos={0 0}, upload=32933]: Uploading piece...
Aug 10 01:01:48.597402725 (31h36m10.556499962s) [upload=32933]: Next returned nil segment
Aug 10 01:01:48.597431770 (31h36m10.556529016s) [upload=32933]: Waiting for error group managing segments...
Aug 10 01:01:48.752014349 (31h36m10.711111586s) [noise=true , address=45.91.116.6:4994 , piece_id=2MGQEM6AYMYS3TFICH372XAJ5KDFWWLVZ5WZ3GBN52FAPEZ7AWOQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.764183504 (31h36m10.723280743s) [noise=true , address=104.36.82.62:4438 , piece_id=X7HZVL5W4JD7HDOWDA4JLWEDCTZYWCDXIY3V4YM6T5VQTB6YV7CA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.767499536 (31h36m10.726596776s) [noise=true , address=104.36.82.61:4393 , piece_id=3GMJBIU35JREP7GZRXNRRMVO3PWITXRG2RNZBBL6KLG4LK53JZRQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.768206250 (31h36m10.727303488s) [noise=true , address=104.36.82.17:4331 , piece_id=VL6YLWAW4KIPPUGE53Q4XPMKN77VV4J67UOMWMXFI3FONEEQFRHA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.784717295 (31h36m10.743814542s) [noise=true , address=104.36.82.45:4919 , piece_id=A35SHXW747WAV4FEZ5FKXLTAI2EW6UWEAIBH3LIUJFKSBC5FZOAQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.790389630 (31h36m10.74948687s) [noise=true , address=104.36.82.54:4174 , piece_id=OKY3CRB4VKH5V3W6B4R5BC6ZIOMHN3BVQIT5ERBDUMAHFMMUFCXA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.795737433 (31h36m10.754834668s) [noise=true , address=104.36.82.46:4487 , piece_id=IOUPCT5OFOHLIVVEFU4WSLFBQTQ3FL4E2E6EG2JYSCTVQUBTXE5Q, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.811496313 (31h36m10.770593551s) [noise=true , address=104.36.82.35:4586 , piece_id=6RWAJIEFGIB7TMGFZ7SYGKNXTYDE4XBRYNNV3GSZUI2GRFGHQKKQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:48.876016153 (31h36m10.835113385s) [noise=true , address=104.36.82.2:4760 , piece_id=LEEKMSCAHRLIX4IQTB4IETMUVRCYY7MQMNLUQQJSG2NKW46NIIUA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.128668981 (31h36m11.087766214s) [noise=true , address=104.36.82.38:4693 , piece_id=JHBJNV6ELU3NLEXZG74TTHXW3O7T37NOH2UZDSMZKYRYVPVST4FQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.286993508 (31h36m11.246090759s) [noise=true , address=104.36.82.6:4891 , piece_id=SXZSJEHR5QSAIJJ7BNQNT7G227TEEAKPHVBDT4ONU5UV32KUI6EQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.297448118 (31h36m11.256545354s) [noise=true , address=64.49.13.169:4715 , piece_id=O5M4VMD3KAL42HHFCPZWFFBLR3ZYTYOO3YTT2LS4ZKHG7V7PXAPQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.335344988 (31h36m11.294442225s) [noise=true , address=104.36.82.37:4659 , piece_id=YUIUMKWNC35DYK6PH2TRCMSTLQJKAFS6MZPEPODKA5NRNIQFKBFQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.385790523 (31h36m11.344887765s) [noise=true , address=104.36.82.58:4272 , piece_id=QYBKISCC2SAUNAPDQAVXHBGEZQ7VSAHRRJSSCEEQQY3YVTTEG73Q, seg_pos={0 0}, upload=32933]: Done uploading piece. err: <nil>
Aug 10 01:01:49.385817561 (31h36m11.344914804s) [seg_pos={0 0}, upload=32933]: Segment reached optimal threshold of 14 pieces.
Aug 10 01:01:49.385995679 (31h36m11.345092918s) [noise=true , address=104.36.82.44:4871 , piece_id=VHL2LZPJGOYZ5FHM65N5IPXVKBHFOYIYN4R63HMUPOYC7UJ4EDTA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 10 01:01:49.386398550 (31h36m11.345495786s) [noise=true , address=104.36.82.37:4661 , piece_id=UMBOP6O2SRWJTCHIM5JBIFQQYZH5F4ABH2MSXBZD4TTH3DGFQ6WQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jxHbnubVkjisrfmNbLTpYRbBpr5jEyJSMSVUcj57pb1sCrG4i): protocol: expected piece hash; context canceled; EOF
Aug 10 01:01:49.386572706 (31h36m11.345669943s) [noise=true , address=104.36.82.43:4852 , piece_id=PXRNCUGJHKRWQWBMWDTR43Y2FWMTW64IU7JV5WR3VVGMM7HAY4SA, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CWXaz1RJdY28Y4jCshs5Ti4GhJKR1LJL1pBBEWGWrzbfZXfav): protocol: write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection; write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33492->104.36.82.43:4852: use of closed network connection
Aug 10 01:01:49.386673261 (31h36m11.345770499s) [noise=true , address=104.36.82.5:4860 , piece_id=QUGJIRTXMWSI5HELKXKLFQ376BDKAFJE53KFCSLXHMKBCFHGGBCQ, seg_pos={0 0}, upload=32933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 139.59.144.22:58874->104.36.82.5:4860: use of closed network connection; write tcp 139.59.144.22:58874->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: context canceled
Aug 10 01:01:49.386696877 (31h36m11.345794115s) [seg_pos={0 0}, upload=32933]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 01:01:49.386798157 (31h36m11.345895403s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 01:01:49.386804000 (31h36m11.345901246s) [upload=32933]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 01:01:49.547584102 (31h36m11.506681348s) [upload=32933]: Done uploading segments...
Aug 10 01:01:49.547691617 (31h36m11.506788856s) [upload=32933]: Upload finished. err: <nil>
Duration: 2.289553385s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
869.577039ms
FAIL (2025-08-10 01:01:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 869.609208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.054278092s
FAIL (2025-08-10 01:01:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.054312681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
876.506546ms
FAIL (2025-08-10 01:01:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 876.535755ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
3.817489729s
FAIL (2025-08-10 01:00:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.817526197s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
917.874448ms
FAIL (2025-08-10 01:00:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 917.931116ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.009390264s
FAIL (2025-08-10 00:59:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 1.009436019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
3.21609228s
FAIL (2025-08-10 00:59:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.216122337s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
853.76876ms
FAIL (2025-08-10 00:58:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 853.802907ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
3.016944375s
FAIL (2025-08-10 00:58:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.016972258s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.081073857s
FAIL (2025-08-10 00:58:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 1.081094897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.........................X.................................] duration:
3.202290742s
FAIL (2025-08-10 00:57:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.202325616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
851.407463ms
FAIL (2025-08-10 00:57:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 851.454286ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.........................X................................] duration:
2.84232231s
FAIL (2025-08-10 00:56:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.84235577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.........................X...............................] duration:
3.041932312s
FAIL (2025-08-10 00:56:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.041969077s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
874.020038ms
FAIL (2025-08-10 00:56:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 874.054314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
964.128253ms
FAIL (2025-08-10 00:55:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 964.156911ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.........................X..............................] duration:
3.199603687s
FAIL (2025-08-10 00:55:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.199636493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
833.000325ms
FAIL (2025-08-10 00:55:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 833.041559ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
859.972319ms
FAIL (2025-08-10 00:54:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 860.00744ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.........................X.............................] duration:
2.822882269s
FAIL (2025-08-10 00:54:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.822913879s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
866.825101ms
FAIL (2025-08-10 00:53:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 866.863328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.........................X............................] duration:
2.941828199s
FAIL (2025-08-10 00:53:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.941857066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
896.527259ms
FAIL (2025-08-10 00:53:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 896.566527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.........................X...........................] duration:
3.65619232s
FAIL (2025-08-10 00:52:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.656227519s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
976.214591ms
FAIL (2025-08-10 00:52:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 976.246836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........................X..........................] duration:
2.60144031s
FAIL (2025-08-10 00:51:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.601467653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.050449282s
FAIL (2025-08-10 00:51:20 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 1.050480067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.........................X.........................] duration:
3.199546941s
FAIL (2025-08-10 00:50:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.199583719s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........X.........................X........................] duration:
3.15511208s
FAIL (2025-08-10 00:50:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.155153237s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
836.312193ms
FAIL (2025-08-10 00:50:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 836.347184ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [XX........X.........................X.......................] duration:
2.845769306s
FAIL (2025-08-10 00:49:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.845799699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
826.598213ms
FAIL (2025-08-10 00:49:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 826.625744ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.XX........X.........................X......................] duration:
3.329050519s
FAIL (2025-08-10 00:49:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.329084138s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..XX........X.........................X.....................] duration:
2.959522547s
FAIL (2025-08-10 00:48:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.959550248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
856.245641ms
FAIL (2025-08-10 00:48:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 856.271996ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...XX........X.........................X....................] duration:
3.134339235s
FAIL (2025-08-10 00:47:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.134368531s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
891.069778ms
FAIL (2025-08-10 00:47:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 891.184181ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....XX........X.........................X...................] duration:
3.044672668s
FAIL (2025-08-10 00:46:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.044750672s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
857.478556ms
FAIL (2025-08-10 00:46:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 857.511208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....XX........X.........................X..................] duration:
3.140344014s
FAIL (2025-08-10 00:45:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.140377701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
840.65659ms
FAIL (2025-08-10 00:45:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 840.678924ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......XX........X.........................X.................] duration:
3.133666365s
FAIL (2025-08-10 00:44:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.133696628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
966.323588ms
FAIL (2025-08-10 00:44:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:32:59.511558395 (31h7m21.47065564s) [upload=32438]: Starting upload Aug 10 00:32:59.511623347 (31h7m21.470720592s) [upload=32438]: Done starting upload Aug 10 00:32:59.511713603 (31h7m21.470810842s) [upload=32438]: Uploading segments... Aug 10 00:32:59.511867080 (31h7m21.470964335s) [upload=32438]: Got next segment. Inline: true Aug 10 00:32:59.511873459 (31h7m21.470970706s) [upload=32438]: Waiting for error group managing segments... Aug 10 00:32:59.511920025 (31h7m21.471017273s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:59.511930308 (31h7m21.471027553s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:32:59.511934090 (31h7m21.471031336s) [upload=32438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:32:59.663297189 (31h7m21.622394444s) [upload=32438]: Done uploading segments... Aug 10 00:32:59.663323002 (31h7m21.622420246s) [upload=32438]: Upload finished. err: <nil>
Duration: 966.357294ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......XX........X.........................X................] duration:
3.973733093s
FAIL (2025-08-10 00:44:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.973767565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........XX........X.........................X...............] duration:
2.960606895s
FAIL (2025-08-10 00:43:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:32:55.240979275 (31h7m17.200076514s) [upload=32437]: Starting upload Aug 10 00:32:55.241043240 (31h7m17.200140485s) [upload=32437]: Done starting upload Aug 10 00:32:55.241415179 (31h7m17.200512425s) [upload=32437]: Uploading segments... Aug 10 00:32:55.241494442 (31h7m17.20059169s) [upload=32437]: Got next segment. Inline: false Aug 10 00:32:55.241539695 (31h7m17.20063694s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:32:55.241557100 (31h7m17.200654345s) [upload=32437]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:32:55.367543857 (31h7m17.326641103s) [upload=32437]: Next segment err: metaclient: Too Many Requests Aug 10 00:32:55.367569873 (31h7m17.326667118s) [upload=32437]: Done uploading segments... Aug 10 00:32:55.367586466 (31h7m17.326683711s) [upload=32437]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.96065422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|