Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X......X.......................X....X..] duration:
3.269101729s
FAIL (2025-08-19 20:49:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:48:09.730790422 (267h22m31.689887658s) [upload=278326]: Starting upload Aug 19 20:48:09.730890016 (267h22m31.689987266s) [upload=278326]: Done starting upload Aug 19 20:48:09.731130961 (267h22m31.690228209s) [upload=278326]: Uploading segments... Aug 19 20:48:09.731335662 (267h22m31.690432934s) [upload=278326]: Got next segment. Inline: false Aug 19 20:48:09.731424581 (267h22m31.690521833s) [upload=278326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:48:09.731450528 (267h22m31.690547776s) [upload=278326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:48:09.836303650 (267h22m31.795400895s) [upload=278326]: Next segment err: metaclient: Too Many Requests Aug 19 20:48:09.836327041 (267h22m31.795424287s) [upload=278326]: Done uploading segments... Aug 19 20:48:09.836344150 (267h22m31.795441387s) [upload=278326]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.269291937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X...X....X................................X............] duration:
931.649971ms
FAIL (2025-08-19 20:48:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 931.691877ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X......X.......................X....X.] duration:
3.11523494s
FAIL (2025-08-19 20:48:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:48:09.730790422 (267h22m31.689887658s) [upload=278326]: Starting upload Aug 19 20:48:09.730890016 (267h22m31.689987266s) [upload=278326]: Done starting upload Aug 19 20:48:09.731130961 (267h22m31.690228209s) [upload=278326]: Uploading segments... Aug 19 20:48:09.731335662 (267h22m31.690432934s) [upload=278326]: Got next segment. Inline: false Aug 19 20:48:09.731424581 (267h22m31.690521833s) [upload=278326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:48:09.731450528 (267h22m31.690547776s) [upload=278326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:48:09.836303650 (267h22m31.795400895s) [upload=278326]: Next segment err: metaclient: Too Many Requests Aug 19 20:48:09.836327041 (267h22m31.795424287s) [upload=278326]: Done uploading segments... Aug 19 20:48:09.836344150 (267h22m31.795441387s) [upload=278326]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.115272078s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X......X.......................X....X] duration:
386.127926ms
FAIL (2025-08-19 20:48:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:48:09.730790422 (267h22m31.689887658s) [upload=278326]: Starting upload Aug 19 20:48:09.730890016 (267h22m31.689987266s) [upload=278326]: Done starting upload Aug 19 20:48:09.731130961 (267h22m31.690228209s) [upload=278326]: Uploading segments... Aug 19 20:48:09.731335662 (267h22m31.690432934s) [upload=278326]: Got next segment. Inline: false Aug 19 20:48:09.731424581 (267h22m31.690521833s) [upload=278326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:48:09.731450528 (267h22m31.690547776s) [upload=278326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:48:09.836303650 (267h22m31.795400895s) [upload=278326]: Next segment err: metaclient: Too Many Requests Aug 19 20:48:09.836327041 (267h22m31.795424287s) [upload=278326]: Done uploading segments... Aug 19 20:48:09.836344150 (267h22m31.795441387s) [upload=278326]: Upload finished. err: metaclient: Too Many Requests
Duration: 386.153079ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X...X....X................................X...........] duration:
883.069798ms
FAIL (2025-08-19 20:47:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 883.108161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X......X.......................X....] duration:
3.582832068s
FAIL (2025-08-19 20:46:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 20:43:50.102188195 (267h18m12.06128544s) [upload=278246]: Starting upload
Aug 19 20:43:50.102255020 (267h18m12.061352253s) [upload=278246]: Done starting upload
Aug 19 20:43:50.102385935 (267h18m12.06148318s) [upload=278246]: Uploading segments...
Aug 19 20:43:50.102581179 (267h18m12.061678427s) [upload=278246]: Got next segment. Inline: false
Aug 19 20:43:50.102633117 (267h18m12.061730362s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 20:43:50.102638033 (267h18m12.061735278s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 20:43:50.303817284 (267h18m12.26291454s) [seg_pos={0 0}, upload=278246]: Begin upload segment...
Aug 19 20:43:50.303887773 (267h18m12.262985025s) [seg_pos={0 0}, upload=278246]: Done begin upload segment.
Aug 19 20:43:50.303914498 (267h18m12.263011749s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.303941379 (267h18m12.26303864s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304321849 (267h18m12.263419081s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304335410 (267h18m12.26343266s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304642415 (267h18m12.263739661s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304892977 (267h18m12.263990225s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306061422 (267h18m12.265158676s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306384348 (267h18m12.265481596s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307620361 (267h18m12.266717616s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307679622 (267h18m12.266776893s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308400204 (267h18m12.267497456s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308752146 (267h18m12.267849392s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309089606 (267h18m12.268186854s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309341514 (267h18m12.268438762s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309608898 (267h18m12.268706159s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309932824 (267h18m12.26903007s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310230198 (267h18m12.269327455s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310530936 (267h18m12.269628184s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.865278153 (267h18m12.8243754s) [upload=278246]: Next returned nil segment
Aug 19 20:43:50.865293942 (267h18m12.82439119s) [upload=278246]: Waiting for error group managing segments...
Aug 19 20:43:51.014323811 (267h18m12.973421046s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.066832119 (267h18m13.025929351s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.069843414 (267h18m13.028940656s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.077641928 (267h18m13.036739166s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.092157857 (267h18m13.05125511s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.095241774 (267h18m13.054339013s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.108783335 (267h18m13.067880567s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.112047570 (267h18m13.071144801s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.186705402 (267h18m13.145802648s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.198491372 (267h18m13.157588623s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.228316716 (267h18m13.187413956s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.599984190 (267h18m13.559081435s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.848397572 (267h18m13.807494809s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969143283 (267h18m13.92824053s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969201866 (267h18m13.928299113s) [seg_pos={0 0}, upload=278246]: Segment reached optimal threshold of 14 pieces.
Aug 19 20:43:51.969381482 (267h18m13.928478732s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pf65Tg83xM523bgdJK2BxiC6uzJ1Hh528DY8CUDxGTnxZSd2W): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969477030 (267h18m13.928574279s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NkWHX2ojDAfX4CHoHSDE5mrLczUHwWQwm9rKPU7NUUB2GJgqY): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969664509 (267h18m13.928761741s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969683170 (267h18m13.928780439s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969715119 (267h18m13.928812371s) [seg_pos={0 0}, upload=278246]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 20:43:51.969801055 (267h18m13.928898288s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 20:43:51.969806518 (267h18m13.928903751s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 20:43:52.157030802 (267h18m14.116128048s) [upload=278246]: Done uploading segments...
Aug 19 20:43:52.157052922 (267h18m14.116150161s) [upload=278246]: Upload finished. err: <nil>
Duration: 3.582857813s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X......X.......................X...] duration:
3.218384291s
FAIL (2025-08-19 20:46:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 20:43:50.102188195 (267h18m12.06128544s) [upload=278246]: Starting upload
Aug 19 20:43:50.102255020 (267h18m12.061352253s) [upload=278246]: Done starting upload
Aug 19 20:43:50.102385935 (267h18m12.06148318s) [upload=278246]: Uploading segments...
Aug 19 20:43:50.102581179 (267h18m12.061678427s) [upload=278246]: Got next segment. Inline: false
Aug 19 20:43:50.102633117 (267h18m12.061730362s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 20:43:50.102638033 (267h18m12.061735278s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 20:43:50.303817284 (267h18m12.26291454s) [seg_pos={0 0}, upload=278246]: Begin upload segment...
Aug 19 20:43:50.303887773 (267h18m12.262985025s) [seg_pos={0 0}, upload=278246]: Done begin upload segment.
Aug 19 20:43:50.303914498 (267h18m12.263011749s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.303941379 (267h18m12.26303864s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304321849 (267h18m12.263419081s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304335410 (267h18m12.26343266s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304642415 (267h18m12.263739661s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304892977 (267h18m12.263990225s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306061422 (267h18m12.265158676s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306384348 (267h18m12.265481596s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307620361 (267h18m12.266717616s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307679622 (267h18m12.266776893s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308400204 (267h18m12.267497456s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308752146 (267h18m12.267849392s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309089606 (267h18m12.268186854s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309341514 (267h18m12.268438762s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309608898 (267h18m12.268706159s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309932824 (267h18m12.26903007s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310230198 (267h18m12.269327455s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310530936 (267h18m12.269628184s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.865278153 (267h18m12.8243754s) [upload=278246]: Next returned nil segment
Aug 19 20:43:50.865293942 (267h18m12.82439119s) [upload=278246]: Waiting for error group managing segments...
Aug 19 20:43:51.014323811 (267h18m12.973421046s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.066832119 (267h18m13.025929351s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.069843414 (267h18m13.028940656s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.077641928 (267h18m13.036739166s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.092157857 (267h18m13.05125511s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.095241774 (267h18m13.054339013s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.108783335 (267h18m13.067880567s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.112047570 (267h18m13.071144801s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.186705402 (267h18m13.145802648s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.198491372 (267h18m13.157588623s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.228316716 (267h18m13.187413956s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.599984190 (267h18m13.559081435s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.848397572 (267h18m13.807494809s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969143283 (267h18m13.92824053s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969201866 (267h18m13.928299113s) [seg_pos={0 0}, upload=278246]: Segment reached optimal threshold of 14 pieces.
Aug 19 20:43:51.969381482 (267h18m13.928478732s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pf65Tg83xM523bgdJK2BxiC6uzJ1Hh528DY8CUDxGTnxZSd2W): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969477030 (267h18m13.928574279s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NkWHX2ojDAfX4CHoHSDE5mrLczUHwWQwm9rKPU7NUUB2GJgqY): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969664509 (267h18m13.928761741s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969683170 (267h18m13.928780439s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969715119 (267h18m13.928812371s) [seg_pos={0 0}, upload=278246]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 20:43:51.969801055 (267h18m13.928898288s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 20:43:51.969806518 (267h18m13.928903751s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 20:43:52.157030802 (267h18m14.116128048s) [upload=278246]: Done uploading segments...
Aug 19 20:43:52.157052922 (267h18m14.116150161s) [upload=278246]: Upload finished. err: <nil>
Duration: 3.21847407s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X...X....X................................X..........] duration:
1.094057668s
FAIL (2025-08-19 20:46:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.094090616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X...X....X................................X.........] duration:
1.035393051s
FAIL (2025-08-19 20:46:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.035429079s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X...X....X................................X........] duration:
948.800776ms
FAIL (2025-08-19 20:45:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 948.855116ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X......X.......................X..] duration:
3.162211224s
FAIL (2025-08-19 20:45:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 20:43:50.102188195 (267h18m12.06128544s) [upload=278246]: Starting upload
Aug 19 20:43:50.102255020 (267h18m12.061352253s) [upload=278246]: Done starting upload
Aug 19 20:43:50.102385935 (267h18m12.06148318s) [upload=278246]: Uploading segments...
Aug 19 20:43:50.102581179 (267h18m12.061678427s) [upload=278246]: Got next segment. Inline: false
Aug 19 20:43:50.102633117 (267h18m12.061730362s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 20:43:50.102638033 (267h18m12.061735278s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 20:43:50.303817284 (267h18m12.26291454s) [seg_pos={0 0}, upload=278246]: Begin upload segment...
Aug 19 20:43:50.303887773 (267h18m12.262985025s) [seg_pos={0 0}, upload=278246]: Done begin upload segment.
Aug 19 20:43:50.303914498 (267h18m12.263011749s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.303941379 (267h18m12.26303864s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304321849 (267h18m12.263419081s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304335410 (267h18m12.26343266s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304642415 (267h18m12.263739661s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304892977 (267h18m12.263990225s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306061422 (267h18m12.265158676s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306384348 (267h18m12.265481596s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307620361 (267h18m12.266717616s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307679622 (267h18m12.266776893s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308400204 (267h18m12.267497456s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308752146 (267h18m12.267849392s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309089606 (267h18m12.268186854s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309341514 (267h18m12.268438762s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309608898 (267h18m12.268706159s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309932824 (267h18m12.26903007s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310230198 (267h18m12.269327455s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310530936 (267h18m12.269628184s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.865278153 (267h18m12.8243754s) [upload=278246]: Next returned nil segment
Aug 19 20:43:50.865293942 (267h18m12.82439119s) [upload=278246]: Waiting for error group managing segments...
Aug 19 20:43:51.014323811 (267h18m12.973421046s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.066832119 (267h18m13.025929351s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.069843414 (267h18m13.028940656s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.077641928 (267h18m13.036739166s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.092157857 (267h18m13.05125511s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.095241774 (267h18m13.054339013s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.108783335 (267h18m13.067880567s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.112047570 (267h18m13.071144801s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.186705402 (267h18m13.145802648s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.198491372 (267h18m13.157588623s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.228316716 (267h18m13.187413956s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.599984190 (267h18m13.559081435s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.848397572 (267h18m13.807494809s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969143283 (267h18m13.92824053s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969201866 (267h18m13.928299113s) [seg_pos={0 0}, upload=278246]: Segment reached optimal threshold of 14 pieces.
Aug 19 20:43:51.969381482 (267h18m13.928478732s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pf65Tg83xM523bgdJK2BxiC6uzJ1Hh528DY8CUDxGTnxZSd2W): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969477030 (267h18m13.928574279s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NkWHX2ojDAfX4CHoHSDE5mrLczUHwWQwm9rKPU7NUUB2GJgqY): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969664509 (267h18m13.928761741s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969683170 (267h18m13.928780439s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969715119 (267h18m13.928812371s) [seg_pos={0 0}, upload=278246]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 20:43:51.969801055 (267h18m13.928898288s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 20:43:51.969806518 (267h18m13.928903751s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 20:43:52.157030802 (267h18m14.116128048s) [upload=278246]: Done uploading segments...
Aug 19 20:43:52.157052922 (267h18m14.116150161s) [upload=278246]: Upload finished. err: <nil>
Duration: 3.162248188s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X...X....X................................X.......] duration:
1.120668272s
FAIL (2025-08-19 20:44:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.120722726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X......X.......................X.] duration:
3.272456292s
FAIL (2025-08-19 20:44:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 20:43:50.102188195 (267h18m12.06128544s) [upload=278246]: Starting upload
Aug 19 20:43:50.102255020 (267h18m12.061352253s) [upload=278246]: Done starting upload
Aug 19 20:43:50.102385935 (267h18m12.06148318s) [upload=278246]: Uploading segments...
Aug 19 20:43:50.102581179 (267h18m12.061678427s) [upload=278246]: Got next segment. Inline: false
Aug 19 20:43:50.102633117 (267h18m12.061730362s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 20:43:50.102638033 (267h18m12.061735278s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 20:43:50.303817284 (267h18m12.26291454s) [seg_pos={0 0}, upload=278246]: Begin upload segment...
Aug 19 20:43:50.303887773 (267h18m12.262985025s) [seg_pos={0 0}, upload=278246]: Done begin upload segment.
Aug 19 20:43:50.303914498 (267h18m12.263011749s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.303941379 (267h18m12.26303864s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304321849 (267h18m12.263419081s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304335410 (267h18m12.26343266s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304642415 (267h18m12.263739661s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304892977 (267h18m12.263990225s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306061422 (267h18m12.265158676s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306384348 (267h18m12.265481596s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307620361 (267h18m12.266717616s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307679622 (267h18m12.266776893s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308400204 (267h18m12.267497456s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308752146 (267h18m12.267849392s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309089606 (267h18m12.268186854s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309341514 (267h18m12.268438762s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309608898 (267h18m12.268706159s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309932824 (267h18m12.26903007s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310230198 (267h18m12.269327455s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310530936 (267h18m12.269628184s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.865278153 (267h18m12.8243754s) [upload=278246]: Next returned nil segment
Aug 19 20:43:50.865293942 (267h18m12.82439119s) [upload=278246]: Waiting for error group managing segments...
Aug 19 20:43:51.014323811 (267h18m12.973421046s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.066832119 (267h18m13.025929351s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.069843414 (267h18m13.028940656s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.077641928 (267h18m13.036739166s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.092157857 (267h18m13.05125511s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.095241774 (267h18m13.054339013s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.108783335 (267h18m13.067880567s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.112047570 (267h18m13.071144801s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.186705402 (267h18m13.145802648s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.198491372 (267h18m13.157588623s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.228316716 (267h18m13.187413956s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.599984190 (267h18m13.559081435s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.848397572 (267h18m13.807494809s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969143283 (267h18m13.92824053s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969201866 (267h18m13.928299113s) [seg_pos={0 0}, upload=278246]: Segment reached optimal threshold of 14 pieces.
Aug 19 20:43:51.969381482 (267h18m13.928478732s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pf65Tg83xM523bgdJK2BxiC6uzJ1Hh528DY8CUDxGTnxZSd2W): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969477030 (267h18m13.928574279s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NkWHX2ojDAfX4CHoHSDE5mrLczUHwWQwm9rKPU7NUUB2GJgqY): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969664509 (267h18m13.928761741s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969683170 (267h18m13.928780439s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969715119 (267h18m13.928812371s) [seg_pos={0 0}, upload=278246]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 20:43:51.969801055 (267h18m13.928898288s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 20:43:51.969806518 (267h18m13.928903751s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 20:43:52.157030802 (267h18m14.116128048s) [upload=278246]: Done uploading segments...
Aug 19 20:43:52.157052922 (267h18m14.116150161s) [upload=278246]: Upload finished. err: <nil>
Duration: 3.272486101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X...X....X................................X......] duration:
894.626565ms
FAIL (2025-08-19 20:44:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 894.716528ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...........................X......X.......................X] duration:
2.645282797s
FAIL (2025-08-19 20:43:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 20:43:50.102188195 (267h18m12.06128544s) [upload=278246]: Starting upload
Aug 19 20:43:50.102255020 (267h18m12.061352253s) [upload=278246]: Done starting upload
Aug 19 20:43:50.102385935 (267h18m12.06148318s) [upload=278246]: Uploading segments...
Aug 19 20:43:50.102581179 (267h18m12.061678427s) [upload=278246]: Got next segment. Inline: false
Aug 19 20:43:50.102633117 (267h18m12.061730362s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 20:43:50.102638033 (267h18m12.061735278s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 20:43:50.303817284 (267h18m12.26291454s) [seg_pos={0 0}, upload=278246]: Begin upload segment...
Aug 19 20:43:50.303887773 (267h18m12.262985025s) [seg_pos={0 0}, upload=278246]: Done begin upload segment.
Aug 19 20:43:50.303914498 (267h18m12.263011749s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.303941379 (267h18m12.26303864s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304321849 (267h18m12.263419081s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304335410 (267h18m12.26343266s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304642415 (267h18m12.263739661s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.304892977 (267h18m12.263990225s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306061422 (267h18m12.265158676s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.306384348 (267h18m12.265481596s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307620361 (267h18m12.266717616s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.307679622 (267h18m12.266776893s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308400204 (267h18m12.267497456s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.308752146 (267h18m12.267849392s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309089606 (267h18m12.268186854s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309341514 (267h18m12.268438762s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309608898 (267h18m12.268706159s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.309932824 (267h18m12.26903007s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310230198 (267h18m12.269327455s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.310530936 (267h18m12.269628184s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Uploading piece...
Aug 19 20:43:50.865278153 (267h18m12.8243754s) [upload=278246]: Next returned nil segment
Aug 19 20:43:50.865293942 (267h18m12.82439119s) [upload=278246]: Waiting for error group managing segments...
Aug 19 20:43:51.014323811 (267h18m12.973421046s) [noise=true , address=45.91.116.12:4240 , piece_id=KRCMMMHSUS6OHSNG5WYLXOSDHT7RNDYZ2BDO7KO455G34XQLFURA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.066832119 (267h18m13.025929351s) [noise=true , address=77.90.31.17:4780 , piece_id=ZC4RJ5IVTYB4U7GZ2URQC67IQXR3W3IH67KKWSQGEHLMT3UTCKEA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.069843414 (267h18m13.028940656s) [noise=true , address=45.91.116.7:4037 , piece_id=ADQWUTL3QSCNB67BEVAVYSLHNUYHRCHRA67L7KUIEJG2CHUJOWFA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.077641928 (267h18m13.036739166s) [noise=true , address=45.91.116.14:4193 , piece_id=N57FNZLFUB5FWVY6JIHZFZPQ2YB4Q67AINLC62OBIBE5MC3WZBDA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.092157857 (267h18m13.05125511s) [noise=true , address=77.90.31.11:4569 , piece_id=QK6LEGTLCHJFXMPMF3SRU5TCH75CYFBKGQJN6NKMCQ7MRPYPKY4A, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.095241774 (267h18m13.054339013s) [noise=true , address=77.90.31.15:4720 , piece_id=HEAN3H5VYYMBR3COHGTTODUY4D4HJG7WNEJYCK4K3HBBWWHEYVVA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.108783335 (267h18m13.067880567s) [noise=true , address=45.91.116.5:4300 , piece_id=J4PSWYGDUQFIUFABYZ7OX5PIMCCDTYIRAMRRVBNNFE33NNCRMBFQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.112047570 (267h18m13.071144801s) [noise=true , address=77.90.31.19:4859 , piece_id=U2DQLAQO4EIS7OEOJBD7WN4URH4AVSQSRMHZQIL4PVTZFCC7VSNA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.186705402 (267h18m13.145802648s) [noise=true , address=77.90.31.21:4899 , piece_id=ZCN3HVC5B2THWJUWWV7J5LLBBIWYD3NAXKTNPL3PFNL5YZC4IGXA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.198491372 (267h18m13.157588623s) [noise=true , address=77.90.31.18:4831 , piece_id=6OSJWXNXTQ2VIDIZODEOAMWGSOVXDEEAS32BXEJBA7E7OP4A75KQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.228316716 (267h18m13.187413956s) [noise=true , address=77.90.31.16:4767 , piece_id=RFB6IIGHMRVBYHAZOJB72B7DVLIKZG5NHFEIO4PG6ETYKJ5FFAIA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.599984190 (267h18m13.559081435s) [noise=true , address=104.36.82.36:4630 , piece_id=7QJAMKMRFOQ6NGDUKLBGY4H3ED3AJG464WN6CNOWESQ3KQEMBIOA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.848397572 (267h18m13.807494809s) [noise=true , address=104.36.82.2:4743 , piece_id=DYWFO27SOB7B3YLD6B2LLKDLHK4RDQLM6XKOKVCYV62IQ7JSZWKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969143283 (267h18m13.92824053s) [noise=true , address=104.36.82.60:4368 , piece_id=Y5X46LGX236IF5T5XVWDLWS7Y4PITL4HPP2HDI46NXDE2Z3YZVAA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: <nil>
Aug 19 20:43:51.969201866 (267h18m13.928299113s) [seg_pos={0 0}, upload=278246]: Segment reached optimal threshold of 14 pieces.
Aug 19 20:43:51.969381482 (267h18m13.928478732s) [noise=true , address=104.36.82.40:4956 , piece_id=APD7VNIIPKEPKMRJ3H5HJO3IWBBUAP6B4N7ONGW7ZJ6V3U5IXRKA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pf65Tg83xM523bgdJK2BxiC6uzJ1Hh528DY8CUDxGTnxZSd2W): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969477030 (267h18m13.928574279s) [noise=true , address=104.36.82.18:4397 , piece_id=D6ZNE5EUB5TJ27AH3UUQGJO63CFQQ2NMBRVB6TEIBL5PHKS7S7DQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NkWHX2ojDAfX4CHoHSDE5mrLczUHwWQwm9rKPU7NUUB2GJgqY): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969664509 (267h18m13.928761741s) [noise=true , address=104.36.82.20:4439 , piece_id=55C6LZ3WEZL5IURUWI433PDWBSDPACPEFSVNJ2FHFTRLOLON5RDQ, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969683170 (267h18m13.928780439s) [noise=true , address=104.36.82.39:4752 , piece_id=H752FBNGEROTA33BKUTZYZ3DKNZT42C2WUZCQ7NT5MFMNBSZUALA, seg_pos={0 0}, upload=278246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF
Aug 19 20:43:51.969715119 (267h18m13.928812371s) [seg_pos={0 0}, upload=278246]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 20:43:51.969801055 (267h18m13.928898288s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 20:43:51.969806518 (267h18m13.928903751s) [upload=278246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 20:43:52.157030802 (267h18m14.116128048s) [upload=278246]: Done uploading segments...
Aug 19 20:43:52.157052922 (267h18m14.116150161s) [upload=278246]: Upload finished. err: <nil>
Duration: 2.645311595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X...X....X................................X.....] duration:
1.082424591s
FAIL (2025-08-19 20:43:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.082456458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X...X....X................................X....] duration:
1.564021964s
FAIL (2025-08-19 20:43:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.564122443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X...........................X......X.......................] duration:
2.917971613s
FAIL (2025-08-19 20:43:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.917994628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X...X....X................................X...] duration:
1.433775196s
FAIL (2025-08-19 20:43:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.433820131s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X...X....X................................X..] duration:
982.880896ms
FAIL (2025-08-19 20:42:30 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 982.918361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.X...........................X......X......................] duration:
2.773531836s
FAIL (2025-08-19 20:42:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.773567473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X...X....X................................X.] duration:
1.073674098s
FAIL (2025-08-19 20:42:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 1.073719212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.X...........................X......X.....................] duration:
3.375737028s
FAIL (2025-08-19 20:41:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.375772458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X...X....X................................X] duration:
662.412364ms
FAIL (2025-08-19 20:41:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil>
Duration: 662.435888ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.X...........................X......X....................] duration:
2.57117114s
FAIL (2025-08-19 20:40:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.571202157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X...X....X................................] duration:
995.827216ms
FAIL (2025-08-19 20:40:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 995.864041ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X...X....X...............................] duration:
845.814003ms
FAIL (2025-08-19 20:39:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.84626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.X...........................X......X...................] duration:
3.169222189s
FAIL (2025-08-19 20:39:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.16925446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X...X....X..............................] duration:
904.891102ms
FAIL (2025-08-19 20:39:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 904.928533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.X...........................X......X..................] duration:
3.446075537s
FAIL (2025-08-19 20:38:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.446118624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...X....X.............................] duration:
956.549602ms
FAIL (2025-08-19 20:38:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 956.588479ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.X...........................X......X.................] duration:
3.201777921s
FAIL (2025-08-19 20:37:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.201813855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X...X....X............................] duration:
881.774109ms
FAIL (2025-08-19 20:37:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 881.828833ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X...X....X...........................] duration:
1.496930431s
FAIL (2025-08-19 20:36:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.496961039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.X...........................X......X................] duration:
3.050953265s
FAIL (2025-08-19 20:36:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.050983453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X...X....X..........................] duration:
1.02414645s
FAIL (2025-08-19 20:36:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.024181917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X...........................X......X...............] duration:
2.968970339s
FAIL (2025-08-19 20:35:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.969002383s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X...X....X.........................] duration:
1.082269497s
FAIL (2025-08-19 20:35:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.082322183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.X...........................X......X..............] duration:
2.733770941s
FAIL (2025-08-19 20:35:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.733809492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X...X....X........................] duration:
904.805941ms
FAIL (2025-08-19 20:34:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 904.837779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X...X....X.......................] duration:
981.112254ms
FAIL (2025-08-19 20:34:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 981.150091ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.X...........................X......X.............] duration:
2.663452687s
FAIL (2025-08-19 20:33:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.663499416s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X...X....X......................] duration:
907.338723ms
FAIL (2025-08-19 20:33:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.595339ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X...X....X.....................] duration:
968.986197ms
FAIL (2025-08-19 20:33:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 969.014513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X.X...........................X......X............] duration:
2.814947866s
FAIL (2025-08-19 20:32:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.814975926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X...X....X....................] duration:
1.04788705s
FAIL (2025-08-19 20:32:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.047917367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X.X...........................X......X...........] duration:
3.39073674s
FAIL (2025-08-19 20:32:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.390771555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X...X....X...................] duration:
1.07036919s
FAIL (2025-08-19 20:32:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.070414905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X...X....X..................] duration:
901.004244ms
FAIL (2025-08-19 20:31:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:19:13.738827346 (266h53m35.697924593s) [upload=277813]: Starting upload Aug 19 20:19:13.738888131 (266h53m35.697985381s) [upload=277813]: Done starting upload Aug 19 20:19:13.738986424 (266h53m35.698083655s) [upload=277813]: Uploading segments... Aug 19 20:19:13.739043201 (266h53m35.698140453s) [upload=277813]: Got next segment. Inline: true Aug 19 20:19:13.739047927 (266h53m35.698145172s) [upload=277813]: Waiting for error group managing segments... Aug 19 20:19:13.739084562 (266h53m35.698181807s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:19:13.739088624 (266h53m35.698185872s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 20:19:13.739091180 (266h53m35.698188425s) [upload=277813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 20:19:13.827041096 (266h53m35.786138362s) [upload=277813]: Done uploading segments... Aug 19 20:19:13.827061176 (266h53m35.786158423s) [upload=277813]: Upload finished. err: metaclient: Too Many Requests
Duration: 901.051079ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X.X...........................X......X..........] duration:
2.723903523s
FAIL (2025-08-19 20:31:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 20:24:28.248574881 (266h58m50.207672128s) [upload=277905]: Starting upload Aug 19 20:24:28.248658088 (266h58m50.207755326s) [upload=277905]: Done starting upload Aug 19 20:24:28.248778956 (266h58m50.207876194s) [upload=277905]: Uploading segments... Aug 19 20:24:28.248996747 (266h58m50.208093986s) [upload=277905]: Got next segment. Inline: false Aug 19 20:24:28.249049935 (266h58m50.208147182s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 20:24:28.249081957 (266h58m50.208179204s) [upload=277905]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 20:24:28.337457358 (266h58m50.296554612s) [upload=277905]: Next segment err: metaclient: Too Many Requests Aug 19 20:24:28.337479964 (266h58m50.296577218s) [upload=277905]: Done uploading segments... Aug 19 20:24:28.337672817 (266h58m50.296770069s) [upload=277905]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.723936299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|