Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...X.................................................] duration:
1.048845287s
FAIL (2025-08-13 19:38:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.048871542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...................X.....X.............................X.] duration:
2.86684736s
FAIL (2025-08-13 19:38:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 19:36:59.596773929 (122h11m21.555871174s) [upload=127324]: Starting upload
Aug 13 19:36:59.596860928 (122h11m21.555958176s) [upload=127324]: Done starting upload
Aug 13 19:36:59.597109004 (122h11m21.556206243s) [upload=127324]: Uploading segments...
Aug 13 19:36:59.597179549 (122h11m21.556276786s) [upload=127324]: Got next segment. Inline: false
Aug 13 19:36:59.597251025 (122h11m21.556348264s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:36:59.597256462 (122h11m21.556353707s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:36:59.799662554 (122h11m21.758759799s) [seg_pos={0 0}, upload=127324]: Begin upload segment...
Aug 13 19:36:59.799738343 (122h11m21.75883558s) [seg_pos={0 0}, upload=127324]: Done begin upload segment.
Aug 13 19:36:59.799781018 (122h11m21.75887827s) [noise=true , address=104.36.82.3:4791 , piece_id=FBSAZ57C2SNKLHKXZA6EOG2XKGXZSWR3FST7JG7H43OGBIJLTTXQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.799792597 (122h11m21.75888985s) [noise=true , address=64.49.13.26:4953 , piece_id=M2T2JLAJXX7YJYLUIRT4BJK6TH67YEJI3BMFC7ROQYQTXX4LLPTQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.799938004 (122h11m21.759035249s) [noise=true , address=104.36.82.17:4353 , piece_id=FWRFA5VDCUBMGPXYV6YRHH6SDIDXR2R4NYQ3IZJ3AUDZCWQAZ7OA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.800312262 (122h11m21.759409513s) [noise=true , address=104.36.82.23:4449 , piece_id=MYH6DUQ6ACR4PWCCXMNH357EXPX2BBVZ5RJ27HNCTNLVN2OND6UQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.800712827 (122h11m21.759810074s) [noise=true , address=104.36.82.9:4018 , piece_id=46JZU4XG55UTESZ5YCZARSVYY6IRD7RRVYYBN65TNKNF4AWAYYKQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801029677 (122h11m21.760126931s) [noise=true , address=64.49.13.140:4506 , piece_id=SCNCBUB2V5HMFRNBQUEPXADQZLDVXR7SYV2PECWEMBHVBYQUQLNA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801379816 (122h11m21.760477065s) [noise=true , address=104.36.82.36:4619 , piece_id=EER5AAJ326WFMQUG2GHLIFE35UDTDOQQNH7W25IOD55OYZATZYBA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801690843 (122h11m21.760788091s) [noise=true , address=45.91.116.11:4139 , piece_id=PQKEVJRZTPTC3NZXVTE5LCUUXZ3GGXCY655SMFVNDJ7D2VVOAYRA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801949033 (122h11m21.761046289s) [noise=true , address=77.90.31.10:4523 , piece_id=HA44GTFMY43GSSXZ33IIDIBCCRBR455XAJZJLVKJFZ75SPUNP3ZQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.802065787 (122h11m21.76116304s) [noise=true , address=77.90.31.14:4669 , piece_id=2BD5GOUGSQUZTBWG5M3Z6ANAPG5DDEAQVMJHJ7QYDFBNFHF76KBA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.802450386 (122h11m21.761547644s) [noise=true , address=104.36.82.22:4520 , piece_id=26F36OJWH7UBDSDL26QUNQ5WKILXXT6IEMM3ZFDFLSMHQVHET6MA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.802793475 (122h11m21.761890723s) [noise=true , address=104.36.82.44:4883 , piece_id=YJ6GIPWV6MMSRSJZC7MLAKGCC27NX2FENGNF24RUKJJ3YXTWLRWA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.803111467 (122h11m21.762208712s) [noise=true , address=79.127.220.101:4069 , piece_id=OCYXDQZAMTRQ3MEDLDGVFGQNIUTXFUYNCULZ5H4RPPU5JAIHQSGA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.803159078 (122h11m21.762256329s) [noise=true , address=104.36.82.58:4277 , piece_id=23MXU7AARYBZCEEPD3E7OCUQ4F57XQ66MFIN75DGCRDOM2HP3UGA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.803686539 (122h11m21.762783787s) [noise=true , address=64.49.13.170:4718 , piece_id=M4HPZ634XW6N56V2A7X2PXBOS3OLMW4U6NBWVOLQKEGJCZ2AY47A, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.804187682 (122h11m21.763284937s) [noise=true , address=77.90.31.17:4783 , piece_id=43BWIB7ODEII352M72HXWVHVCR3CH4DCE5LS74CK3MTFEWGX4EHQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.805126880 (122h11m21.764224133s) [noise=true , address=79.127.219.38:4006 , piece_id=XXLEL44F7A4GYCS254WV2TE7O3OCPSDQG5CNPOMAXGFRTIFYITCQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.806299252 (122h11m21.765396506s) [noise=true , address=104.36.82.16:4311 , piece_id=ANEO7DRTWKAJUZYXCGH7SM4FX3VGQ7DO6BODP5ZBGEFYYGR4576A, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:37:00.373759056 (122h11m22.332856316s) [upload=127324]: Next returned nil segment
Aug 13 19:37:00.373784581 (122h11m22.332881832s) [upload=127324]: Waiting for error group managing segments...
Aug 13 19:37:00.522456146 (122h11m22.481553412s) [noise=true , address=45.91.116.11:4139 , piece_id=PQKEVJRZTPTC3NZXVTE5LCUUXZ3GGXCY655SMFVNDJ7D2VVOAYRA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.530618545 (122h11m22.489715784s) [noise=true , address=104.36.82.22:4520 , piece_id=26F36OJWH7UBDSDL26QUNQ5WKILXXT6IEMM3ZFDFLSMHQVHET6MA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.545452857 (122h11m22.504550095s) [noise=true , address=77.90.31.14:4669 , piece_id=2BD5GOUGSQUZTBWG5M3Z6ANAPG5DDEAQVMJHJ7QYDFBNFHF76KBA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.558655812 (122h11m22.51775306s) [noise=true , address=104.36.82.17:4353 , piece_id=FWRFA5VDCUBMGPXYV6YRHH6SDIDXR2R4NYQ3IZJ3AUDZCWQAZ7OA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.560994028 (122h11m22.520091267s) [noise=true , address=104.36.82.16:4311 , piece_id=ANEO7DRTWKAJUZYXCGH7SM4FX3VGQ7DO6BODP5ZBGEFYYGR4576A, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.561719057 (122h11m22.520816288s) [noise=true , address=104.36.82.58:4277 , piece_id=23MXU7AARYBZCEEPD3E7OCUQ4F57XQ66MFIN75DGCRDOM2HP3UGA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.562331504 (122h11m22.52142875s) [noise=true , address=77.90.31.17:4783 , piece_id=43BWIB7ODEII352M72HXWVHVCR3CH4DCE5LS74CK3MTFEWGX4EHQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.575084991 (122h11m22.534182238s) [noise=true , address=104.36.82.44:4883 , piece_id=YJ6GIPWV6MMSRSJZC7MLAKGCC27NX2FENGNF24RUKJJ3YXTWLRWA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.589896728 (122h11m22.548993977s) [noise=true , address=104.36.82.23:4449 , piece_id=MYH6DUQ6ACR4PWCCXMNH357EXPX2BBVZ5RJ27HNCTNLVN2OND6UQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.597367291 (122h11m22.55646453s) [noise=true , address=104.36.82.3:4791 , piece_id=FBSAZ57C2SNKLHKXZA6EOG2XKGXZSWR3FST7JG7H43OGBIJLTTXQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.612497338 (122h11m22.571594571s) [noise=true , address=104.36.82.9:4018 , piece_id=46JZU4XG55UTESZ5YCZARSVYY6IRD7RRVYYBN65TNKNF4AWAYYKQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.629425923 (122h11m22.588523155s) [noise=true , address=104.36.82.36:4619 , piece_id=EER5AAJ326WFMQUG2GHLIFE35UDTDOQQNH7W25IOD55OYZATZYBA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.630776237 (122h11m22.58987348s) [noise=true , address=77.90.31.10:4523 , piece_id=HA44GTFMY43GSSXZ33IIDIBCCRBR455XAJZJLVKJFZ75SPUNP3ZQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.638482929 (122h11m22.597580175s) [noise=true , address=79.127.219.38:4006 , piece_id=XXLEL44F7A4GYCS254WV2TE7O3OCPSDQG5CNPOMAXGFRTIFYITCQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.638525252 (122h11m22.597622497s) [seg_pos={0 0}, upload=127324]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:37:00.638845514 (122h11m22.597942767s) [noise=true , address=64.49.13.140:4506 , piece_id=SCNCBUB2V5HMFRNBQUEPXADQZLDVXR7SYV2PECWEMBHVBYQUQLNA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: write tcp 139.59.144.22:52478->64.49.13.140:4506: use of closed network connection; write tcp 139.59.144.22:52478->64.49.13.140:4506: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52478->64.49.13.140:4506: use of closed network connection
Aug 13 19:37:00.638933133 (122h11m22.598030378s) [noise=true , address=79.127.220.101:4069 , piece_id=OCYXDQZAMTRQ3MEDLDGVFGQNIUTXFUYNCULZ5H4RPPU5JAIHQSGA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF
Aug 13 19:37:00.638973245 (122h11m22.598070494s) [noise=true , address=64.49.13.170:4718 , piece_id=M4HPZ634XW6N56V2A7X2PXBOS3OLMW4U6NBWVOLQKEGJCZ2AY47A, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcLsSmVz9sRtuDLs47WoWYC66YSbr2aXBjzBdjayg22daQ2Hp): protocol: write tcp 139.59.144.22:44714->64.49.13.170:4718: use of closed network connection; write tcp 139.59.144.22:44714->64.49.13.170:4718: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44714->64.49.13.170:4718: use of closed network connection
Aug 13 19:37:00.638994338 (122h11m22.598091585s) [noise=true , address=64.49.13.26:4953 , piece_id=M2T2JLAJXX7YJYLUIRT4BJK6TH67YEJI3BMFC7ROQYQTXX4LLPTQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:58408->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:58408->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58408->64.49.13.26:4953: use of closed network connection
Aug 13 19:37:00.639036263 (122h11m22.598133509s) [seg_pos={0 0}, upload=127324]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:37:00.639134003 (122h11m22.598231249s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:37:00.639148285 (122h11m22.59824552s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:37:00.840324933 (122h11m22.799422167s) [upload=127324]: Done uploading segments...
Aug 13 19:37:00.840363952 (122h11m22.799461185s) [upload=127324]: Upload finished. err: <nil>
Duration: 2.866887875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...X................................................] duration:
1.076485879s
FAIL (2025-08-13 19:37:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.076517068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...................X.....X.............................X] duration:
1.726954519s
FAIL (2025-08-13 19:37:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 19:36:59.596773929 (122h11m21.555871174s) [upload=127324]: Starting upload
Aug 13 19:36:59.596860928 (122h11m21.555958176s) [upload=127324]: Done starting upload
Aug 13 19:36:59.597109004 (122h11m21.556206243s) [upload=127324]: Uploading segments...
Aug 13 19:36:59.597179549 (122h11m21.556276786s) [upload=127324]: Got next segment. Inline: false
Aug 13 19:36:59.597251025 (122h11m21.556348264s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:36:59.597256462 (122h11m21.556353707s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:36:59.799662554 (122h11m21.758759799s) [seg_pos={0 0}, upload=127324]: Begin upload segment...
Aug 13 19:36:59.799738343 (122h11m21.75883558s) [seg_pos={0 0}, upload=127324]: Done begin upload segment.
Aug 13 19:36:59.799781018 (122h11m21.75887827s) [noise=true , address=104.36.82.3:4791 , piece_id=FBSAZ57C2SNKLHKXZA6EOG2XKGXZSWR3FST7JG7H43OGBIJLTTXQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.799792597 (122h11m21.75888985s) [noise=true , address=64.49.13.26:4953 , piece_id=M2T2JLAJXX7YJYLUIRT4BJK6TH67YEJI3BMFC7ROQYQTXX4LLPTQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.799938004 (122h11m21.759035249s) [noise=true , address=104.36.82.17:4353 , piece_id=FWRFA5VDCUBMGPXYV6YRHH6SDIDXR2R4NYQ3IZJ3AUDZCWQAZ7OA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.800312262 (122h11m21.759409513s) [noise=true , address=104.36.82.23:4449 , piece_id=MYH6DUQ6ACR4PWCCXMNH357EXPX2BBVZ5RJ27HNCTNLVN2OND6UQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.800712827 (122h11m21.759810074s) [noise=true , address=104.36.82.9:4018 , piece_id=46JZU4XG55UTESZ5YCZARSVYY6IRD7RRVYYBN65TNKNF4AWAYYKQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801029677 (122h11m21.760126931s) [noise=true , address=64.49.13.140:4506 , piece_id=SCNCBUB2V5HMFRNBQUEPXADQZLDVXR7SYV2PECWEMBHVBYQUQLNA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801379816 (122h11m21.760477065s) [noise=true , address=104.36.82.36:4619 , piece_id=EER5AAJ326WFMQUG2GHLIFE35UDTDOQQNH7W25IOD55OYZATZYBA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801690843 (122h11m21.760788091s) [noise=true , address=45.91.116.11:4139 , piece_id=PQKEVJRZTPTC3NZXVTE5LCUUXZ3GGXCY655SMFVNDJ7D2VVOAYRA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.801949033 (122h11m21.761046289s) [noise=true , address=77.90.31.10:4523 , piece_id=HA44GTFMY43GSSXZ33IIDIBCCRBR455XAJZJLVKJFZ75SPUNP3ZQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.802065787 (122h11m21.76116304s) [noise=true , address=77.90.31.14:4669 , piece_id=2BD5GOUGSQUZTBWG5M3Z6ANAPG5DDEAQVMJHJ7QYDFBNFHF76KBA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.802450386 (122h11m21.761547644s) [noise=true , address=104.36.82.22:4520 , piece_id=26F36OJWH7UBDSDL26QUNQ5WKILXXT6IEMM3ZFDFLSMHQVHET6MA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.802793475 (122h11m21.761890723s) [noise=true , address=104.36.82.44:4883 , piece_id=YJ6GIPWV6MMSRSJZC7MLAKGCC27NX2FENGNF24RUKJJ3YXTWLRWA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.803111467 (122h11m21.762208712s) [noise=true , address=79.127.220.101:4069 , piece_id=OCYXDQZAMTRQ3MEDLDGVFGQNIUTXFUYNCULZ5H4RPPU5JAIHQSGA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.803159078 (122h11m21.762256329s) [noise=true , address=104.36.82.58:4277 , piece_id=23MXU7AARYBZCEEPD3E7OCUQ4F57XQ66MFIN75DGCRDOM2HP3UGA, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.803686539 (122h11m21.762783787s) [noise=true , address=64.49.13.170:4718 , piece_id=M4HPZ634XW6N56V2A7X2PXBOS3OLMW4U6NBWVOLQKEGJCZ2AY47A, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.804187682 (122h11m21.763284937s) [noise=true , address=77.90.31.17:4783 , piece_id=43BWIB7ODEII352M72HXWVHVCR3CH4DCE5LS74CK3MTFEWGX4EHQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.805126880 (122h11m21.764224133s) [noise=true , address=79.127.219.38:4006 , piece_id=XXLEL44F7A4GYCS254WV2TE7O3OCPSDQG5CNPOMAXGFRTIFYITCQ, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:36:59.806299252 (122h11m21.765396506s) [noise=true , address=104.36.82.16:4311 , piece_id=ANEO7DRTWKAJUZYXCGH7SM4FX3VGQ7DO6BODP5ZBGEFYYGR4576A, seg_pos={0 0}, upload=127324]: Uploading piece...
Aug 13 19:37:00.373759056 (122h11m22.332856316s) [upload=127324]: Next returned nil segment
Aug 13 19:37:00.373784581 (122h11m22.332881832s) [upload=127324]: Waiting for error group managing segments...
Aug 13 19:37:00.522456146 (122h11m22.481553412s) [noise=true , address=45.91.116.11:4139 , piece_id=PQKEVJRZTPTC3NZXVTE5LCUUXZ3GGXCY655SMFVNDJ7D2VVOAYRA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.530618545 (122h11m22.489715784s) [noise=true , address=104.36.82.22:4520 , piece_id=26F36OJWH7UBDSDL26QUNQ5WKILXXT6IEMM3ZFDFLSMHQVHET6MA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.545452857 (122h11m22.504550095s) [noise=true , address=77.90.31.14:4669 , piece_id=2BD5GOUGSQUZTBWG5M3Z6ANAPG5DDEAQVMJHJ7QYDFBNFHF76KBA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.558655812 (122h11m22.51775306s) [noise=true , address=104.36.82.17:4353 , piece_id=FWRFA5VDCUBMGPXYV6YRHH6SDIDXR2R4NYQ3IZJ3AUDZCWQAZ7OA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.560994028 (122h11m22.520091267s) [noise=true , address=104.36.82.16:4311 , piece_id=ANEO7DRTWKAJUZYXCGH7SM4FX3VGQ7DO6BODP5ZBGEFYYGR4576A, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.561719057 (122h11m22.520816288s) [noise=true , address=104.36.82.58:4277 , piece_id=23MXU7AARYBZCEEPD3E7OCUQ4F57XQ66MFIN75DGCRDOM2HP3UGA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.562331504 (122h11m22.52142875s) [noise=true , address=77.90.31.17:4783 , piece_id=43BWIB7ODEII352M72HXWVHVCR3CH4DCE5LS74CK3MTFEWGX4EHQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.575084991 (122h11m22.534182238s) [noise=true , address=104.36.82.44:4883 , piece_id=YJ6GIPWV6MMSRSJZC7MLAKGCC27NX2FENGNF24RUKJJ3YXTWLRWA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.589896728 (122h11m22.548993977s) [noise=true , address=104.36.82.23:4449 , piece_id=MYH6DUQ6ACR4PWCCXMNH357EXPX2BBVZ5RJ27HNCTNLVN2OND6UQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.597367291 (122h11m22.55646453s) [noise=true , address=104.36.82.3:4791 , piece_id=FBSAZ57C2SNKLHKXZA6EOG2XKGXZSWR3FST7JG7H43OGBIJLTTXQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.612497338 (122h11m22.571594571s) [noise=true , address=104.36.82.9:4018 , piece_id=46JZU4XG55UTESZ5YCZARSVYY6IRD7RRVYYBN65TNKNF4AWAYYKQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.629425923 (122h11m22.588523155s) [noise=true , address=104.36.82.36:4619 , piece_id=EER5AAJ326WFMQUG2GHLIFE35UDTDOQQNH7W25IOD55OYZATZYBA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.630776237 (122h11m22.58987348s) [noise=true , address=77.90.31.10:4523 , piece_id=HA44GTFMY43GSSXZ33IIDIBCCRBR455XAJZJLVKJFZ75SPUNP3ZQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.638482929 (122h11m22.597580175s) [noise=true , address=79.127.219.38:4006 , piece_id=XXLEL44F7A4GYCS254WV2TE7O3OCPSDQG5CNPOMAXGFRTIFYITCQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: <nil>
Aug 13 19:37:00.638525252 (122h11m22.597622497s) [seg_pos={0 0}, upload=127324]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:37:00.638845514 (122h11m22.597942767s) [noise=true , address=64.49.13.140:4506 , piece_id=SCNCBUB2V5HMFRNBQUEPXADQZLDVXR7SYV2PECWEMBHVBYQUQLNA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: write tcp 139.59.144.22:52478->64.49.13.140:4506: use of closed network connection; write tcp 139.59.144.22:52478->64.49.13.140:4506: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52478->64.49.13.140:4506: use of closed network connection
Aug 13 19:37:00.638933133 (122h11m22.598030378s) [noise=true , address=79.127.220.101:4069 , piece_id=OCYXDQZAMTRQ3MEDLDGVFGQNIUTXFUYNCULZ5H4RPPU5JAIHQSGA, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF
Aug 13 19:37:00.638973245 (122h11m22.598070494s) [noise=true , address=64.49.13.170:4718 , piece_id=M4HPZ634XW6N56V2A7X2PXBOS3OLMW4U6NBWVOLQKEGJCZ2AY47A, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcLsSmVz9sRtuDLs47WoWYC66YSbr2aXBjzBdjayg22daQ2Hp): protocol: write tcp 139.59.144.22:44714->64.49.13.170:4718: use of closed network connection; write tcp 139.59.144.22:44714->64.49.13.170:4718: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44714->64.49.13.170:4718: use of closed network connection
Aug 13 19:37:00.638994338 (122h11m22.598091585s) [noise=true , address=64.49.13.26:4953 , piece_id=M2T2JLAJXX7YJYLUIRT4BJK6TH67YEJI3BMFC7ROQYQTXX4LLPTQ, seg_pos={0 0}, upload=127324]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:58408->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:58408->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58408->64.49.13.26:4953: use of closed network connection
Aug 13 19:37:00.639036263 (122h11m22.598133509s) [seg_pos={0 0}, upload=127324]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:37:00.639134003 (122h11m22.598231249s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:37:00.639148285 (122h11m22.59824552s) [upload=127324]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:37:00.840324933 (122h11m22.799422167s) [upload=127324]: Done uploading segments...
Aug 13 19:37:00.840363952 (122h11m22.799461185s) [upload=127324]: Upload finished. err: <nil>
Duration: 1.726985846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...X...............................................] duration:
1.409784623s
FAIL (2025-08-13 19:36:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.409811631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X.....X.............................] duration:
3.196808516s
FAIL (2025-08-13 19:36:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.196834051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...X..............................................] duration:
928.758808ms
FAIL (2025-08-13 19:36:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 928.789216ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration:
1.664990498s
FAIL (2025-08-13 19:35:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.665027795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X.....X............................] duration:
2.527035961s
FAIL (2025-08-13 19:35:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.527066048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...X............................................] duration:
942.519515ms
FAIL (2025-08-13 19:34:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 942.556139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X.....X...........................] duration:
2.365275983s
FAIL (2025-08-13 19:34:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.365308323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X.....X..........................] duration:
2.392962638s
FAIL (2025-08-13 19:33:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.393063979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X...X...........................................] duration:
1.164935141s
FAIL (2025-08-13 19:33:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.164963959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X.....X.........................] duration:
2.592001264s
FAIL (2025-08-13 19:33:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.592025091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration:
1.019273742s
FAIL (2025-08-13 19:32:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.019299686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X.....X........................] duration:
2.514895568s
FAIL (2025-08-13 19:32:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.514940168s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X.....X.......................] duration:
3.25970803s
FAIL (2025-08-13 19:32:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.259744041s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration:
864.247638ms
FAIL (2025-08-13 19:32:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.278228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X.....X......................] duration:
2.411497924s
FAIL (2025-08-13 19:31:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.411527626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X...X........................................] duration:
905.832961ms
FAIL (2025-08-13 19:31:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 905.871859ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...................X.....X.....................] duration:
2.608346345s
FAIL (2025-08-13 19:30:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.608375085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...................X.....X....................] duration:
2.637877184s
FAIL (2025-08-13 19:30:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.63793193s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X...X.......................................] duration:
2.250617797s
FAIL (2025-08-13 19:30:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.250649666s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...................X.....X...................] duration:
2.597064214s
FAIL (2025-08-13 19:29:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.597095748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X...X......................................] duration:
884.014576ms
FAIL (2025-08-13 19:29:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.045405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...................X.....X..................] duration:
3.071751799s
FAIL (2025-08-13 19:29:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.071840794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...................X.....X.................] duration:
2.834592277s
FAIL (2025-08-13 19:28:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.834624646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration:
863.133003ms
FAIL (2025-08-13 19:28:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.164562ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...................X.....X................] duration:
2.400412237s
FAIL (2025-08-13 19:27:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.400474818s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X...X....................................] duration:
902.463769ms
FAIL (2025-08-13 19:27:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.520605ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...................X.....X...............] duration:
2.795773961s
FAIL (2025-08-13 19:26:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.795801854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...X...................................] duration:
939.195953ms
FAIL (2025-08-13 19:26:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 939.244561ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration:
1.169307168s
FAIL (2025-08-13 19:25:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.16934161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X...................X.....X..............] duration:
2.47398167s
FAIL (2025-08-13 19:25:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.474035326s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...X.................................] duration:
1.026632617s
FAIL (2025-08-13 19:25:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.026674905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X...................X.....X.............] duration:
2.569456884s
FAIL (2025-08-13 19:24:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.569506957s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...X................................] duration:
853.984011ms
FAIL (2025-08-13 19:24:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.194729ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...................X.....X............] duration:
2.618379946s
FAIL (2025-08-13 19:23:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.618417943s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X...................X.....X...........] duration:
2.720304716s
FAIL (2025-08-13 19:22:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.720364918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X...X...............................] duration:
879.827304ms
FAIL (2025-08-13 19:22:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.862114ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration:
1.286866629s
FAIL (2025-08-13 19:22:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.286898972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X...................X.....X..........] duration:
2.43582119s
FAIL (2025-08-13 19:22:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.435852382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X...................X.....X.........] duration:
2.703052289s
FAIL (2025-08-13 19:21:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.703084121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration:
1.126572507s
FAIL (2025-08-13 19:21:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.126627334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X...................X.....X........] duration:
3.361368107s
FAIL (2025-08-13 19:20:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.361395652s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..........................X...X............................] duration:
1.151647247s
FAIL (2025-08-13 19:20:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.151680853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X...................X.....X.......] duration:
2.853818118s
FAIL (2025-08-13 19:19:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.853851436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..........................X...X...........................] duration:
1.127559605s
FAIL (2025-08-13 19:19:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:57:47.577301894 (121h32m9.536399141s) [upload=126641]: Starting upload Aug 13 18:57:47.577371665 (121h32m9.536468917s) [upload=126641]: Done starting upload Aug 13 18:57:47.577481577 (121h32m9.536578822s) [upload=126641]: Uploading segments... Aug 13 18:57:47.577532653 (121h32m9.536629908s) [upload=126641]: Got next segment. Inline: true Aug 13 18:57:47.577538283 (121h32m9.536635529s) [upload=126641]: Waiting for error group managing segments... Aug 13 18:57:47.577583762 (121h32m9.536681007s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:57:47.577588785 (121h32m9.536686031s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:57:47.577592206 (121h32m9.536689452s) [upload=126641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:57:47.667307413 (121h32m9.626404661s) [upload=126641]: Done uploading segments... Aug 13 18:57:47.667324762 (121h32m9.626422001s) [upload=126641]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.127593447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X...................X.....X......] duration:
2.801755574s
FAIL (2025-08-13 19:19:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.801863533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X...................X.....X.....] duration:
2.509948629s
FAIL (2025-08-13 19:18:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 19:14:21.294452974 (121h48m43.25355021s) [upload=126936]: Starting upload Aug 13 19:14:21.294519179 (121h48m43.25361643s) [upload=126936]: Done starting upload Aug 13 19:14:21.294623464 (121h48m43.253720704s) [upload=126936]: Uploading segments... Aug 13 19:14:21.294809424 (121h48m43.253906676s) [upload=126936]: Got next segment. Inline: false Aug 13 19:14:21.294884619 (121h48m43.253981871s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 19:14:21.294892953 (121h48m43.253990209s) [upload=126936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 19:14:21.382443938 (121h48m43.341541174s) [upload=126936]: Next segment err: metaclient: Too Many Requests Aug 13 19:14:21.382482223 (121h48m43.341579468s) [upload=126936]: Done uploading segments... Aug 13 19:14:21.382500774 (121h48m43.341598013s) [upload=126936]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.509979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|