Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X.......................X..........................] duration:
841.918074ms
FAIL (2025-08-12 07:16:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.946682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................XX..............X..................X....X..] duration:
2.460933154s
FAIL (2025-08-12 07:16:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:13:56.307924742 (85h48m18.267022s) [upload=89454]: Starting upload
Aug 12 07:13:56.308007277 (85h48m18.267104521s) [upload=89454]: Done starting upload
Aug 12 07:13:56.308168298 (85h48m18.267265541s) [upload=89454]: Uploading segments...
Aug 12 07:13:56.308455070 (85h48m18.267552318s) [upload=89454]: Got next segment. Inline: false
Aug 12 07:13:56.308496406 (85h48m18.267593656s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:13:56.308503759 (85h48m18.267601016s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:13:56.503488193 (85h48m18.462585442s) [seg_pos={0 0}, upload=89454]: Begin upload segment...
Aug 12 07:13:56.503576652 (85h48m18.462673896s) [seg_pos={0 0}, upload=89454]: Done begin upload segment.
Aug 12 07:13:56.503620016 (85h48m18.462717268s) [noise=true , address=64.49.13.170:4720 , piece_id=RWR3I4TWTF3FGL2QJZQUNAZWDDEJDEFNOVH7Y3U22M4FVBF7QCQQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.503650687 (85h48m18.462747934s) [noise=true , address=79.127.205.233:4625 , piece_id=X2PASPAT7MRZGFVSVQ6DZCS6TFF66FS7CIOIS3QXJORASJDBEZYA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504177469 (85h48m18.463274721s) [noise=true , address=45.91.116.7:4028 , piece_id=7BTDOBR45VLQFPRYE46LS2RZYXLUMPKD32NRLWWEGWUOZ5UMS2KA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504292233 (85h48m18.463389485s) [noise=true , address=104.36.82.8:4001 , piece_id=OLIKFICNRJZVOQNQY6OK3GTJ426VBTX5BNUWN34AR3QMIOLTP3CA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504602328 (85h48m18.463699583s) [noise=true , address=104.36.82.13:4215 , piece_id=QQXKJI4VBCT3SMSKB56D4PXMJKXXODQ3CVMNHQGN5N4UJ7UKPY3Q, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504717875 (85h48m18.463815124s) [noise=true , address=64.49.13.26:4953 , piece_id=NKBL5MTQWTGOXH52IWW54UUCDQOVCPRDJPUH7UFA3H3XI3EPKTTQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505037188 (85h48m18.464134445s) [noise=true , address=104.36.82.37:4671 , piece_id=47BP22JYVFB6GHAM3KVVNBTPFUC6J7NWYVUUZEEJNUQJT2PM73LQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505171924 (85h48m18.464269171s) [noise=true , address=104.36.82.35:4615 , piece_id=OKE7A7ADX6UVWEP6HQHS4W7E6OUAIESG4EKZHXYGH6JCM7YMPBGQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505456808 (85h48m18.464554048s) [noise=true , address=104.36.82.12:4160 , piece_id=P4BJ3UQOQDL2DLMEJ6HRXHLMHPGEJ7XWELDNGFJOHPNGHX66DJNA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505572908 (85h48m18.464670154s) [noise=true , address=104.36.82.61:4378 , piece_id=JGG75KDW57EDAQPMNLXP7LW2WRUOCZA7EGNPFXB4TWQKG7MD5QKA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505987107 (85h48m18.465084377s) [noise=true , address=104.36.82.58:4283 , piece_id=STHOLJNW4EUOTPWTSIDNLTEXT4OPQMC3LGQN7XXTZZBXS6B55ACQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.506463776 (85h48m18.465561091s) [noise=true , address=77.90.31.18:4831 , piece_id=LURC4GCTYUYFJJUWFNVGVPM755UBGNWGOCLIJZKPEDMMHNKNCFSA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507130572 (85h48m18.46622783s) [noise=true , address=104.36.82.34:4577 , piece_id=LYPD7GJFTST5HZLYW7QWG5GWAAL2YVLH74PJQU2WPII5DATWQBOA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507218591 (85h48m18.466315843s) [noise=true , address=104.36.82.44:4883 , piece_id=AZN3MZTEUZTEOH6SI4WUJXNJD5STESHAZUD6UH6NPIZHGBZ2GGIQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507628121 (85h48m18.466725373s) [noise=true , address=104.36.82.17:4340 , piece_id=ROEBLLWA2WKWNFVWJHS3PPA6IKOIY5S4MFE3SIEFH45AUMGU456A, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508070745 (85h48m18.467167997s) [noise=true , address=104.36.82.62:4413 , piece_id=5CSZMZS4ZDG6XLO3ZCWXUYUMPZSOAPMHRYDNIKFPDU3SBGDZJCUA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508334481 (85h48m18.467431733s) [noise=true , address=104.36.82.38:4711 , piece_id=TOJXAHJ75IYLVC2BTVSZI6V2YTFR5TW6DQR3GGMOITKOHUGH67VA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508797901 (85h48m18.467895148s) [noise=true , address=104.36.82.23:4473 , piece_id=NI233K6OQJTTRSO232Z7HQN6Q6CMWYDCZRVKANP3XB23OOHLKMXA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:57.083018483 (85h48m19.04211574s) [upload=89454]: Next returned nil segment
Aug 12 07:13:57.083039957 (85h48m19.042137213s) [upload=89454]: Waiting for error group managing segments...
Aug 12 07:13:57.259315597 (85h48m19.218412837s) [noise=true , address=104.36.82.8:4001 , piece_id=OLIKFICNRJZVOQNQY6OK3GTJ426VBTX5BNUWN34AR3QMIOLTP3CA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.259449268 (85h48m19.218546509s) [noise=true , address=104.36.82.62:4413 , piece_id=5CSZMZS4ZDG6XLO3ZCWXUYUMPZSOAPMHRYDNIKFPDU3SBGDZJCUA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.259879186 (85h48m19.218976425s) [noise=true , address=104.36.82.34:4577 , piece_id=LYPD7GJFTST5HZLYW7QWG5GWAAL2YVLH74PJQU2WPII5DATWQBOA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.260149322 (85h48m19.219246553s) [noise=true , address=77.90.31.18:4831 , piece_id=LURC4GCTYUYFJJUWFNVGVPM755UBGNWGOCLIJZKPEDMMHNKNCFSA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.263804293 (85h48m19.222901525s) [noise=true , address=104.36.82.35:4615 , piece_id=OKE7A7ADX6UVWEP6HQHS4W7E6OUAIESG4EKZHXYGH6JCM7YMPBGQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.263979047 (85h48m19.223076298s) [noise=true , address=104.36.82.61:4378 , piece_id=JGG75KDW57EDAQPMNLXP7LW2WRUOCZA7EGNPFXB4TWQKG7MD5QKA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.264316553 (85h48m19.223413787s) [noise=true , address=104.36.82.13:4215 , piece_id=QQXKJI4VBCT3SMSKB56D4PXMJKXXODQ3CVMNHQGN5N4UJ7UKPY3Q, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.265885712 (85h48m19.224982944s) [noise=true , address=45.91.116.7:4028 , piece_id=7BTDOBR45VLQFPRYE46LS2RZYXLUMPKD32NRLWWEGWUOZ5UMS2KA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.269831650 (85h48m19.228928912s) [noise=true , address=104.36.82.38:4711 , piece_id=TOJXAHJ75IYLVC2BTVSZI6V2YTFR5TW6DQR3GGMOITKOHUGH67VA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.270852311 (85h48m19.229949562s) [noise=true , address=104.36.82.17:4340 , piece_id=ROEBLLWA2WKWNFVWJHS3PPA6IKOIY5S4MFE3SIEFH45AUMGU456A, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.284854238 (85h48m19.243951478s) [noise=true , address=104.36.82.12:4160 , piece_id=P4BJ3UQOQDL2DLMEJ6HRXHLMHPGEJ7XWELDNGFJOHPNGHX66DJNA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.285972947 (85h48m19.245070179s) [noise=true , address=104.36.82.37:4671 , piece_id=47BP22JYVFB6GHAM3KVVNBTPFUC6J7NWYVUUZEEJNUQJT2PM73LQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.291718528 (85h48m19.250815763s) [noise=true , address=104.36.82.23:4473 , piece_id=NI233K6OQJTTRSO232Z7HQN6Q6CMWYDCZRVKANP3XB23OOHLKMXA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.322608462 (85h48m19.281705709s) [noise=true , address=104.36.82.58:4283 , piece_id=STHOLJNW4EUOTPWTSIDNLTEXT4OPQMC3LGQN7XXTZZBXS6B55ACQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.322632314 (85h48m19.281729549s) [seg_pos={0 0}, upload=89454]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:13:57.323085480 (85h48m19.282182716s) [noise=true , address=104.36.82.44:4883 , piece_id=AZN3MZTEUZTEOH6SI4WUJXNJD5STESHAZUD6UH6NPIZHGBZ2GGIQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cx1avL4umDm2pzJS1rNZqeDZjZMWnMtNsyNTdMdkxhpa1ByUN): protocol: expected piece hash; context canceled; EOF
Aug 12 07:13:57.323265935 (85h48m19.282363171s) [noise=true , address=64.49.13.26:4953 , piece_id=NKBL5MTQWTGOXH52IWW54UUCDQOVCPRDJPUH7UFA3H3XI3EPKTTQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection
Aug 12 07:13:57.323340180 (85h48m19.282437415s) [noise=true , address=64.49.13.170:4720 , piece_id=RWR3I4TWTF3FGL2QJZQUNAZWDDEJDEFNOVH7Y3U22M4FVBF7QCQQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121G3pHPJtX2aW9Buo62YYmjErqHbok6rWdVVGdSMpVPhwGeNHS): protocol: write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection; write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection
Aug 12 07:13:57.323409069 (85h48m19.282506308s) [noise=true , address=79.127.205.233:4625 , piece_id=X2PASPAT7MRZGFVSVQ6DZCS6TFF66FS7CIOIS3QXJORASJDBEZYA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection
Aug 12 07:13:57.323423928 (85h48m19.282521174s) [seg_pos={0 0}, upload=89454]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:13:57.323502638 (85h48m19.282599883s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:13:57.323507441 (85h48m19.282604689s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:13:57.462720153 (85h48m19.421817392s) [upload=89454]: Done uploading segments...
Aug 12 07:13:57.462754902 (85h48m19.42185214s) [upload=89454]: Upload finished. err: <nil>
Duration: 2.460965899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X.......................X.........................] duration:
1.041723665s
FAIL (2025-08-12 07:16:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.041761159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X.......................X........................] duration:
851.83769ms
FAIL (2025-08-12 07:15:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.867275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X.......................X.......................] duration:
993.23691ms
FAIL (2025-08-12 07:15:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 993.262996ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X.......................X......................] duration:
946.179629ms
FAIL (2025-08-12 07:15:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 946.210183ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................XX..............X..................X....X.] duration:
2.59125344s
FAIL (2025-08-12 07:15:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:13:56.307924742 (85h48m18.267022s) [upload=89454]: Starting upload
Aug 12 07:13:56.308007277 (85h48m18.267104521s) [upload=89454]: Done starting upload
Aug 12 07:13:56.308168298 (85h48m18.267265541s) [upload=89454]: Uploading segments...
Aug 12 07:13:56.308455070 (85h48m18.267552318s) [upload=89454]: Got next segment. Inline: false
Aug 12 07:13:56.308496406 (85h48m18.267593656s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:13:56.308503759 (85h48m18.267601016s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:13:56.503488193 (85h48m18.462585442s) [seg_pos={0 0}, upload=89454]: Begin upload segment...
Aug 12 07:13:56.503576652 (85h48m18.462673896s) [seg_pos={0 0}, upload=89454]: Done begin upload segment.
Aug 12 07:13:56.503620016 (85h48m18.462717268s) [noise=true , address=64.49.13.170:4720 , piece_id=RWR3I4TWTF3FGL2QJZQUNAZWDDEJDEFNOVH7Y3U22M4FVBF7QCQQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.503650687 (85h48m18.462747934s) [noise=true , address=79.127.205.233:4625 , piece_id=X2PASPAT7MRZGFVSVQ6DZCS6TFF66FS7CIOIS3QXJORASJDBEZYA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504177469 (85h48m18.463274721s) [noise=true , address=45.91.116.7:4028 , piece_id=7BTDOBR45VLQFPRYE46LS2RZYXLUMPKD32NRLWWEGWUOZ5UMS2KA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504292233 (85h48m18.463389485s) [noise=true , address=104.36.82.8:4001 , piece_id=OLIKFICNRJZVOQNQY6OK3GTJ426VBTX5BNUWN34AR3QMIOLTP3CA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504602328 (85h48m18.463699583s) [noise=true , address=104.36.82.13:4215 , piece_id=QQXKJI4VBCT3SMSKB56D4PXMJKXXODQ3CVMNHQGN5N4UJ7UKPY3Q, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504717875 (85h48m18.463815124s) [noise=true , address=64.49.13.26:4953 , piece_id=NKBL5MTQWTGOXH52IWW54UUCDQOVCPRDJPUH7UFA3H3XI3EPKTTQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505037188 (85h48m18.464134445s) [noise=true , address=104.36.82.37:4671 , piece_id=47BP22JYVFB6GHAM3KVVNBTPFUC6J7NWYVUUZEEJNUQJT2PM73LQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505171924 (85h48m18.464269171s) [noise=true , address=104.36.82.35:4615 , piece_id=OKE7A7ADX6UVWEP6HQHS4W7E6OUAIESG4EKZHXYGH6JCM7YMPBGQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505456808 (85h48m18.464554048s) [noise=true , address=104.36.82.12:4160 , piece_id=P4BJ3UQOQDL2DLMEJ6HRXHLMHPGEJ7XWELDNGFJOHPNGHX66DJNA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505572908 (85h48m18.464670154s) [noise=true , address=104.36.82.61:4378 , piece_id=JGG75KDW57EDAQPMNLXP7LW2WRUOCZA7EGNPFXB4TWQKG7MD5QKA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505987107 (85h48m18.465084377s) [noise=true , address=104.36.82.58:4283 , piece_id=STHOLJNW4EUOTPWTSIDNLTEXT4OPQMC3LGQN7XXTZZBXS6B55ACQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.506463776 (85h48m18.465561091s) [noise=true , address=77.90.31.18:4831 , piece_id=LURC4GCTYUYFJJUWFNVGVPM755UBGNWGOCLIJZKPEDMMHNKNCFSA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507130572 (85h48m18.46622783s) [noise=true , address=104.36.82.34:4577 , piece_id=LYPD7GJFTST5HZLYW7QWG5GWAAL2YVLH74PJQU2WPII5DATWQBOA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507218591 (85h48m18.466315843s) [noise=true , address=104.36.82.44:4883 , piece_id=AZN3MZTEUZTEOH6SI4WUJXNJD5STESHAZUD6UH6NPIZHGBZ2GGIQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507628121 (85h48m18.466725373s) [noise=true , address=104.36.82.17:4340 , piece_id=ROEBLLWA2WKWNFVWJHS3PPA6IKOIY5S4MFE3SIEFH45AUMGU456A, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508070745 (85h48m18.467167997s) [noise=true , address=104.36.82.62:4413 , piece_id=5CSZMZS4ZDG6XLO3ZCWXUYUMPZSOAPMHRYDNIKFPDU3SBGDZJCUA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508334481 (85h48m18.467431733s) [noise=true , address=104.36.82.38:4711 , piece_id=TOJXAHJ75IYLVC2BTVSZI6V2YTFR5TW6DQR3GGMOITKOHUGH67VA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508797901 (85h48m18.467895148s) [noise=true , address=104.36.82.23:4473 , piece_id=NI233K6OQJTTRSO232Z7HQN6Q6CMWYDCZRVKANP3XB23OOHLKMXA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:57.083018483 (85h48m19.04211574s) [upload=89454]: Next returned nil segment
Aug 12 07:13:57.083039957 (85h48m19.042137213s) [upload=89454]: Waiting for error group managing segments...
Aug 12 07:13:57.259315597 (85h48m19.218412837s) [noise=true , address=104.36.82.8:4001 , piece_id=OLIKFICNRJZVOQNQY6OK3GTJ426VBTX5BNUWN34AR3QMIOLTP3CA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.259449268 (85h48m19.218546509s) [noise=true , address=104.36.82.62:4413 , piece_id=5CSZMZS4ZDG6XLO3ZCWXUYUMPZSOAPMHRYDNIKFPDU3SBGDZJCUA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.259879186 (85h48m19.218976425s) [noise=true , address=104.36.82.34:4577 , piece_id=LYPD7GJFTST5HZLYW7QWG5GWAAL2YVLH74PJQU2WPII5DATWQBOA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.260149322 (85h48m19.219246553s) [noise=true , address=77.90.31.18:4831 , piece_id=LURC4GCTYUYFJJUWFNVGVPM755UBGNWGOCLIJZKPEDMMHNKNCFSA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.263804293 (85h48m19.222901525s) [noise=true , address=104.36.82.35:4615 , piece_id=OKE7A7ADX6UVWEP6HQHS4W7E6OUAIESG4EKZHXYGH6JCM7YMPBGQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.263979047 (85h48m19.223076298s) [noise=true , address=104.36.82.61:4378 , piece_id=JGG75KDW57EDAQPMNLXP7LW2WRUOCZA7EGNPFXB4TWQKG7MD5QKA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.264316553 (85h48m19.223413787s) [noise=true , address=104.36.82.13:4215 , piece_id=QQXKJI4VBCT3SMSKB56D4PXMJKXXODQ3CVMNHQGN5N4UJ7UKPY3Q, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.265885712 (85h48m19.224982944s) [noise=true , address=45.91.116.7:4028 , piece_id=7BTDOBR45VLQFPRYE46LS2RZYXLUMPKD32NRLWWEGWUOZ5UMS2KA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.269831650 (85h48m19.228928912s) [noise=true , address=104.36.82.38:4711 , piece_id=TOJXAHJ75IYLVC2BTVSZI6V2YTFR5TW6DQR3GGMOITKOHUGH67VA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.270852311 (85h48m19.229949562s) [noise=true , address=104.36.82.17:4340 , piece_id=ROEBLLWA2WKWNFVWJHS3PPA6IKOIY5S4MFE3SIEFH45AUMGU456A, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.284854238 (85h48m19.243951478s) [noise=true , address=104.36.82.12:4160 , piece_id=P4BJ3UQOQDL2DLMEJ6HRXHLMHPGEJ7XWELDNGFJOHPNGHX66DJNA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.285972947 (85h48m19.245070179s) [noise=true , address=104.36.82.37:4671 , piece_id=47BP22JYVFB6GHAM3KVVNBTPFUC6J7NWYVUUZEEJNUQJT2PM73LQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.291718528 (85h48m19.250815763s) [noise=true , address=104.36.82.23:4473 , piece_id=NI233K6OQJTTRSO232Z7HQN6Q6CMWYDCZRVKANP3XB23OOHLKMXA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.322608462 (85h48m19.281705709s) [noise=true , address=104.36.82.58:4283 , piece_id=STHOLJNW4EUOTPWTSIDNLTEXT4OPQMC3LGQN7XXTZZBXS6B55ACQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.322632314 (85h48m19.281729549s) [seg_pos={0 0}, upload=89454]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:13:57.323085480 (85h48m19.282182716s) [noise=true , address=104.36.82.44:4883 , piece_id=AZN3MZTEUZTEOH6SI4WUJXNJD5STESHAZUD6UH6NPIZHGBZ2GGIQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cx1avL4umDm2pzJS1rNZqeDZjZMWnMtNsyNTdMdkxhpa1ByUN): protocol: expected piece hash; context canceled; EOF
Aug 12 07:13:57.323265935 (85h48m19.282363171s) [noise=true , address=64.49.13.26:4953 , piece_id=NKBL5MTQWTGOXH52IWW54UUCDQOVCPRDJPUH7UFA3H3XI3EPKTTQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection
Aug 12 07:13:57.323340180 (85h48m19.282437415s) [noise=true , address=64.49.13.170:4720 , piece_id=RWR3I4TWTF3FGL2QJZQUNAZWDDEJDEFNOVH7Y3U22M4FVBF7QCQQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121G3pHPJtX2aW9Buo62YYmjErqHbok6rWdVVGdSMpVPhwGeNHS): protocol: write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection; write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection
Aug 12 07:13:57.323409069 (85h48m19.282506308s) [noise=true , address=79.127.205.233:4625 , piece_id=X2PASPAT7MRZGFVSVQ6DZCS6TFF66FS7CIOIS3QXJORASJDBEZYA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection
Aug 12 07:13:57.323423928 (85h48m19.282521174s) [seg_pos={0 0}, upload=89454]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:13:57.323502638 (85h48m19.282599883s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:13:57.323507441 (85h48m19.282604689s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:13:57.462720153 (85h48m19.421817392s) [upload=89454]: Done uploading segments...
Aug 12 07:13:57.462754902 (85h48m19.42185214s) [upload=89454]: Upload finished. err: <nil>
Duration: 2.591298721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X.......................X.....................] duration:
842.342446ms
FAIL (2025-08-12 07:14:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.378559ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................XX..............X..................X....X] duration:
1.717071636s
FAIL (2025-08-12 07:13:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:13:56.307924742 (85h48m18.267022s) [upload=89454]: Starting upload
Aug 12 07:13:56.308007277 (85h48m18.267104521s) [upload=89454]: Done starting upload
Aug 12 07:13:56.308168298 (85h48m18.267265541s) [upload=89454]: Uploading segments...
Aug 12 07:13:56.308455070 (85h48m18.267552318s) [upload=89454]: Got next segment. Inline: false
Aug 12 07:13:56.308496406 (85h48m18.267593656s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:13:56.308503759 (85h48m18.267601016s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:13:56.503488193 (85h48m18.462585442s) [seg_pos={0 0}, upload=89454]: Begin upload segment...
Aug 12 07:13:56.503576652 (85h48m18.462673896s) [seg_pos={0 0}, upload=89454]: Done begin upload segment.
Aug 12 07:13:56.503620016 (85h48m18.462717268s) [noise=true , address=64.49.13.170:4720 , piece_id=RWR3I4TWTF3FGL2QJZQUNAZWDDEJDEFNOVH7Y3U22M4FVBF7QCQQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.503650687 (85h48m18.462747934s) [noise=true , address=79.127.205.233:4625 , piece_id=X2PASPAT7MRZGFVSVQ6DZCS6TFF66FS7CIOIS3QXJORASJDBEZYA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504177469 (85h48m18.463274721s) [noise=true , address=45.91.116.7:4028 , piece_id=7BTDOBR45VLQFPRYE46LS2RZYXLUMPKD32NRLWWEGWUOZ5UMS2KA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504292233 (85h48m18.463389485s) [noise=true , address=104.36.82.8:4001 , piece_id=OLIKFICNRJZVOQNQY6OK3GTJ426VBTX5BNUWN34AR3QMIOLTP3CA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504602328 (85h48m18.463699583s) [noise=true , address=104.36.82.13:4215 , piece_id=QQXKJI4VBCT3SMSKB56D4PXMJKXXODQ3CVMNHQGN5N4UJ7UKPY3Q, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.504717875 (85h48m18.463815124s) [noise=true , address=64.49.13.26:4953 , piece_id=NKBL5MTQWTGOXH52IWW54UUCDQOVCPRDJPUH7UFA3H3XI3EPKTTQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505037188 (85h48m18.464134445s) [noise=true , address=104.36.82.37:4671 , piece_id=47BP22JYVFB6GHAM3KVVNBTPFUC6J7NWYVUUZEEJNUQJT2PM73LQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505171924 (85h48m18.464269171s) [noise=true , address=104.36.82.35:4615 , piece_id=OKE7A7ADX6UVWEP6HQHS4W7E6OUAIESG4EKZHXYGH6JCM7YMPBGQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505456808 (85h48m18.464554048s) [noise=true , address=104.36.82.12:4160 , piece_id=P4BJ3UQOQDL2DLMEJ6HRXHLMHPGEJ7XWELDNGFJOHPNGHX66DJNA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505572908 (85h48m18.464670154s) [noise=true , address=104.36.82.61:4378 , piece_id=JGG75KDW57EDAQPMNLXP7LW2WRUOCZA7EGNPFXB4TWQKG7MD5QKA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.505987107 (85h48m18.465084377s) [noise=true , address=104.36.82.58:4283 , piece_id=STHOLJNW4EUOTPWTSIDNLTEXT4OPQMC3LGQN7XXTZZBXS6B55ACQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.506463776 (85h48m18.465561091s) [noise=true , address=77.90.31.18:4831 , piece_id=LURC4GCTYUYFJJUWFNVGVPM755UBGNWGOCLIJZKPEDMMHNKNCFSA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507130572 (85h48m18.46622783s) [noise=true , address=104.36.82.34:4577 , piece_id=LYPD7GJFTST5HZLYW7QWG5GWAAL2YVLH74PJQU2WPII5DATWQBOA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507218591 (85h48m18.466315843s) [noise=true , address=104.36.82.44:4883 , piece_id=AZN3MZTEUZTEOH6SI4WUJXNJD5STESHAZUD6UH6NPIZHGBZ2GGIQ, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.507628121 (85h48m18.466725373s) [noise=true , address=104.36.82.17:4340 , piece_id=ROEBLLWA2WKWNFVWJHS3PPA6IKOIY5S4MFE3SIEFH45AUMGU456A, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508070745 (85h48m18.467167997s) [noise=true , address=104.36.82.62:4413 , piece_id=5CSZMZS4ZDG6XLO3ZCWXUYUMPZSOAPMHRYDNIKFPDU3SBGDZJCUA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508334481 (85h48m18.467431733s) [noise=true , address=104.36.82.38:4711 , piece_id=TOJXAHJ75IYLVC2BTVSZI6V2YTFR5TW6DQR3GGMOITKOHUGH67VA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:56.508797901 (85h48m18.467895148s) [noise=true , address=104.36.82.23:4473 , piece_id=NI233K6OQJTTRSO232Z7HQN6Q6CMWYDCZRVKANP3XB23OOHLKMXA, seg_pos={0 0}, upload=89454]: Uploading piece...
Aug 12 07:13:57.083018483 (85h48m19.04211574s) [upload=89454]: Next returned nil segment
Aug 12 07:13:57.083039957 (85h48m19.042137213s) [upload=89454]: Waiting for error group managing segments...
Aug 12 07:13:57.259315597 (85h48m19.218412837s) [noise=true , address=104.36.82.8:4001 , piece_id=OLIKFICNRJZVOQNQY6OK3GTJ426VBTX5BNUWN34AR3QMIOLTP3CA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.259449268 (85h48m19.218546509s) [noise=true , address=104.36.82.62:4413 , piece_id=5CSZMZS4ZDG6XLO3ZCWXUYUMPZSOAPMHRYDNIKFPDU3SBGDZJCUA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.259879186 (85h48m19.218976425s) [noise=true , address=104.36.82.34:4577 , piece_id=LYPD7GJFTST5HZLYW7QWG5GWAAL2YVLH74PJQU2WPII5DATWQBOA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.260149322 (85h48m19.219246553s) [noise=true , address=77.90.31.18:4831 , piece_id=LURC4GCTYUYFJJUWFNVGVPM755UBGNWGOCLIJZKPEDMMHNKNCFSA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.263804293 (85h48m19.222901525s) [noise=true , address=104.36.82.35:4615 , piece_id=OKE7A7ADX6UVWEP6HQHS4W7E6OUAIESG4EKZHXYGH6JCM7YMPBGQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.263979047 (85h48m19.223076298s) [noise=true , address=104.36.82.61:4378 , piece_id=JGG75KDW57EDAQPMNLXP7LW2WRUOCZA7EGNPFXB4TWQKG7MD5QKA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.264316553 (85h48m19.223413787s) [noise=true , address=104.36.82.13:4215 , piece_id=QQXKJI4VBCT3SMSKB56D4PXMJKXXODQ3CVMNHQGN5N4UJ7UKPY3Q, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.265885712 (85h48m19.224982944s) [noise=true , address=45.91.116.7:4028 , piece_id=7BTDOBR45VLQFPRYE46LS2RZYXLUMPKD32NRLWWEGWUOZ5UMS2KA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.269831650 (85h48m19.228928912s) [noise=true , address=104.36.82.38:4711 , piece_id=TOJXAHJ75IYLVC2BTVSZI6V2YTFR5TW6DQR3GGMOITKOHUGH67VA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.270852311 (85h48m19.229949562s) [noise=true , address=104.36.82.17:4340 , piece_id=ROEBLLWA2WKWNFVWJHS3PPA6IKOIY5S4MFE3SIEFH45AUMGU456A, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.284854238 (85h48m19.243951478s) [noise=true , address=104.36.82.12:4160 , piece_id=P4BJ3UQOQDL2DLMEJ6HRXHLMHPGEJ7XWELDNGFJOHPNGHX66DJNA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.285972947 (85h48m19.245070179s) [noise=true , address=104.36.82.37:4671 , piece_id=47BP22JYVFB6GHAM3KVVNBTPFUC6J7NWYVUUZEEJNUQJT2PM73LQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.291718528 (85h48m19.250815763s) [noise=true , address=104.36.82.23:4473 , piece_id=NI233K6OQJTTRSO232Z7HQN6Q6CMWYDCZRVKANP3XB23OOHLKMXA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.322608462 (85h48m19.281705709s) [noise=true , address=104.36.82.58:4283 , piece_id=STHOLJNW4EUOTPWTSIDNLTEXT4OPQMC3LGQN7XXTZZBXS6B55ACQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: <nil>
Aug 12 07:13:57.322632314 (85h48m19.281729549s) [seg_pos={0 0}, upload=89454]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:13:57.323085480 (85h48m19.282182716s) [noise=true , address=104.36.82.44:4883 , piece_id=AZN3MZTEUZTEOH6SI4WUJXNJD5STESHAZUD6UH6NPIZHGBZ2GGIQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cx1avL4umDm2pzJS1rNZqeDZjZMWnMtNsyNTdMdkxhpa1ByUN): protocol: expected piece hash; context canceled; EOF
Aug 12 07:13:57.323265935 (85h48m19.282363171s) [noise=true , address=64.49.13.26:4953 , piece_id=NKBL5MTQWTGOXH52IWW54UUCDQOVCPRDJPUH7UFA3H3XI3EPKTTQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46034->64.49.13.26:4953: use of closed network connection
Aug 12 07:13:57.323340180 (85h48m19.282437415s) [noise=true , address=64.49.13.170:4720 , piece_id=RWR3I4TWTF3FGL2QJZQUNAZWDDEJDEFNOVH7Y3U22M4FVBF7QCQQ, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121G3pHPJtX2aW9Buo62YYmjErqHbok6rWdVVGdSMpVPhwGeNHS): protocol: write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection; write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42316->64.49.13.170:4720: use of closed network connection
Aug 12 07:13:57.323409069 (85h48m19.282506308s) [noise=true , address=79.127.205.233:4625 , piece_id=X2PASPAT7MRZGFVSVQ6DZCS6TFF66FS7CIOIS3QXJORASJDBEZYA, seg_pos={0 0}, upload=89454]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51098->79.127.205.233:4625: use of closed network connection
Aug 12 07:13:57.323423928 (85h48m19.282521174s) [seg_pos={0 0}, upload=89454]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:13:57.323502638 (85h48m19.282599883s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:13:57.323507441 (85h48m19.282604689s) [upload=89454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:13:57.462720153 (85h48m19.421817392s) [upload=89454]: Done uploading segments...
Aug 12 07:13:57.462754902 (85h48m19.42185214s) [upload=89454]: Upload finished. err: <nil>
Duration: 1.71710061s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X.......................X....................] duration:
824.156249ms
FAIL (2025-08-12 07:13:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.185914ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................XX..............X..................X....] duration:
2.46963365s
FAIL (2025-08-12 07:13:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:10:42.678148496 (85h45m4.63724573s) [upload=89402]: Starting upload Aug 12 07:10:42.678218904 (85h45m4.63731615s) [upload=89402]: Done starting upload Aug 12 07:10:42.678302982 (85h45m4.637400219s) [upload=89402]: Uploading segments... Aug 12 07:10:42.678659661 (85h45m4.6377569s) [upload=89402]: Got next segment. Inline: false Aug 12 07:10:42.678726721 (85h45m4.637823956s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:10:42.678733667 (85h45m4.637830903s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 07:10:42.769058857 (85h45m4.728156102s) [upload=89402]: Next segment err: metaclient: Too Many Requests Aug 12 07:10:42.769086800 (85h45m4.728184044s) [upload=89402]: Done uploading segments... Aug 12 07:10:42.769102459 (85h45m4.728199691s) [upload=89402]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.469667628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.......X.......................X...................] duration:
999.928073ms
FAIL (2025-08-12 07:12:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 999.977913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................XX..............X..................X...] duration:
2.616102769s
FAIL (2025-08-12 07:12:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:10:42.678148496 (85h45m4.63724573s) [upload=89402]: Starting upload Aug 12 07:10:42.678218904 (85h45m4.63731615s) [upload=89402]: Done starting upload Aug 12 07:10:42.678302982 (85h45m4.637400219s) [upload=89402]: Uploading segments... Aug 12 07:10:42.678659661 (85h45m4.6377569s) [upload=89402]: Got next segment. Inline: false Aug 12 07:10:42.678726721 (85h45m4.637823956s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:10:42.678733667 (85h45m4.637830903s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 07:10:42.769058857 (85h45m4.728156102s) [upload=89402]: Next segment err: metaclient: Too Many Requests Aug 12 07:10:42.769086800 (85h45m4.728184044s) [upload=89402]: Done uploading segments... Aug 12 07:10:42.769102459 (85h45m4.728199691s) [upload=89402]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.616128448s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................XX..............X..................X..] duration:
2.432948561s
FAIL (2025-08-12 07:11:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:10:42.678148496 (85h45m4.63724573s) [upload=89402]: Starting upload Aug 12 07:10:42.678218904 (85h45m4.63731615s) [upload=89402]: Done starting upload Aug 12 07:10:42.678302982 (85h45m4.637400219s) [upload=89402]: Uploading segments... Aug 12 07:10:42.678659661 (85h45m4.6377569s) [upload=89402]: Got next segment. Inline: false Aug 12 07:10:42.678726721 (85h45m4.637823956s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:10:42.678733667 (85h45m4.637830903s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 07:10:42.769058857 (85h45m4.728156102s) [upload=89402]: Next segment err: metaclient: Too Many Requests Aug 12 07:10:42.769086800 (85h45m4.728184044s) [upload=89402]: Done uploading segments... Aug 12 07:10:42.769102459 (85h45m4.728199691s) [upload=89402]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.433132325s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.......X.......................X..................] duration:
834.710288ms
FAIL (2025-08-12 07:11:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.744512ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................XX..............X..................X.] duration:
2.28725573s
FAIL (2025-08-12 07:11:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:10:42.678148496 (85h45m4.63724573s) [upload=89402]: Starting upload Aug 12 07:10:42.678218904 (85h45m4.63731615s) [upload=89402]: Done starting upload Aug 12 07:10:42.678302982 (85h45m4.637400219s) [upload=89402]: Uploading segments... Aug 12 07:10:42.678659661 (85h45m4.6377569s) [upload=89402]: Got next segment. Inline: false Aug 12 07:10:42.678726721 (85h45m4.637823956s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:10:42.678733667 (85h45m4.637830903s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 07:10:42.769058857 (85h45m4.728156102s) [upload=89402]: Next segment err: metaclient: Too Many Requests Aug 12 07:10:42.769086800 (85h45m4.728184044s) [upload=89402]: Done uploading segments... Aug 12 07:10:42.769102459 (85h45m4.728199691s) [upload=89402]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.287291939s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................XX..............X..................X] duration:
366.192286ms
FAIL (2025-08-12 07:10:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:10:42.678148496 (85h45m4.63724573s) [upload=89402]: Starting upload Aug 12 07:10:42.678218904 (85h45m4.63731615s) [upload=89402]: Done starting upload Aug 12 07:10:42.678302982 (85h45m4.637400219s) [upload=89402]: Uploading segments... Aug 12 07:10:42.678659661 (85h45m4.6377569s) [upload=89402]: Got next segment. Inline: false Aug 12 07:10:42.678726721 (85h45m4.637823956s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:10:42.678733667 (85h45m4.637830903s) [upload=89402]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 07:10:42.769058857 (85h45m4.728156102s) [upload=89402]: Next segment err: metaclient: Too Many Requests Aug 12 07:10:42.769086800 (85h45m4.728184044s) [upload=89402]: Done uploading segments... Aug 12 07:10:42.769102459 (85h45m4.728199691s) [upload=89402]: Upload finished. err: metaclient: Too Many Requests
Duration: 366.219998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.......X.......................X.................] duration:
815.884973ms
FAIL (2025-08-12 07:10:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.925833ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................XX..............X..................] duration:
3.098693604s
FAIL (2025-08-12 07:10:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.098715957s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................XX..............X.................] duration:
2.587214742s
FAIL (2025-08-12 07:09:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.58724213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.......X.......................X................] duration:
857.247138ms
FAIL (2025-08-12 07:09:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.296234ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.......X.......................X...............] duration:
913.114807ms
FAIL (2025-08-12 07:08:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 913.161971ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................XX..............X................] duration:
2.397207292s
FAIL (2025-08-12 07:08:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.39723597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......X.......................X..............] duration:
840.21082ms
FAIL (2025-08-12 07:07:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.245493ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................XX..............X...............] duration:
2.337184112s
FAIL (2025-08-12 07:07:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.33723504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.......X.......................X.............] duration:
826.548082ms
FAIL (2025-08-12 07:06:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.572303ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................XX..............X..............] duration:
2.831864197s
FAIL (2025-08-12 07:06:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.831888989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................XX..............X.............] duration:
2.341836149s
FAIL (2025-08-12 07:05:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.341869203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......X.......................X............] duration:
911.826299ms
FAIL (2025-08-12 07:05:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 911.875197ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................XX..............X............] duration:
2.660066128s
FAIL (2025-08-12 07:05:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.660095388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.......X.......................X...........] duration:
814.711489ms
FAIL (2025-08-12 07:04:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 814.74456ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................XX..............X...........] duration:
2.3192782s
FAIL (2025-08-12 07:04:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.319328642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.......X.......................X..........] duration:
823.940781ms
FAIL (2025-08-12 07:04:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.962343ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................XX..............X..........] duration:
2.493143419s
FAIL (2025-08-12 07:04:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.493170052s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................XX..............X.........] duration:
2.407006203s
FAIL (2025-08-12 07:03:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.407055721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.......X.......................X.........] duration:
936.464194ms
FAIL (2025-08-12 07:03:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 936.501124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..................................XX..............X........] duration:
2.373162497s
FAIL (2025-08-12 07:02:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.373191633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.......X.......................X........] duration:
885.829962ms
FAIL (2025-08-12 07:02:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 885.88037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..................................XX..............X.......] duration:
2.39410291s
FAIL (2025-08-12 07:01:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.394209724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..................................XX..............X......] duration:
2.303892063s
FAIL (2025-08-12 07:01:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.304001577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.......X.......................X.......] duration:
1.07828843s
FAIL (2025-08-12 07:01:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.078322292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.......X.......................X......] duration:
832.368362ms
FAIL (2025-08-12 06:59:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.396739ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..................................XX..............X.....] duration:
2.432248529s
FAIL (2025-08-12 06:59:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.432275413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.......X.......................X.....] duration:
1.004782228s
FAIL (2025-08-12 06:59:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.004826673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..................................XX..............X....] duration:
2.338864658s
FAIL (2025-08-12 06:58:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.338890975s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.......X.......................X....] duration:
894.804631ms
FAIL (2025-08-12 06:58:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 894.835263ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X....X..................................XX..............X...] duration:
2.303170628s
FAIL (2025-08-12 06:57:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.303200747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.......X.......................X...] duration:
810.501312ms
FAIL (2025-08-12 06:57:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 810.546407ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X....X..................................XX..............X..] duration:
2.778706479s
FAIL (2025-08-12 06:57:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:56:04.451552480 (85h30m26.410649743s) [upload=89148]: Starting upload Aug 12 06:56:04.451617122 (85h30m26.41071438s) [upload=89148]: Done starting upload Aug 12 06:56:04.451819797 (85h30m26.41091704s) [upload=89148]: Uploading segments... Aug 12 06:56:04.452081610 (85h30m26.411178862s) [upload=89148]: Got next segment. Inline: false Aug 12 06:56:04.452169647 (85h30m26.411266907s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:56:04.452177967 (85h30m26.411275225s) [upload=89148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 06:56:04.598277625 (85h30m26.55737488s) [upload=89148]: Next segment err: metaclient: Too Many Requests Aug 12 06:56:04.598341468 (85h30m26.557438729s) [upload=89148]: Done uploading segments... Aug 12 06:56:04.598367120 (85h30m26.557464371s) [upload=89148]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.778746755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.......X.......................X..] duration:
847.453221ms
FAIL (2025-08-12 06:56:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 06:54:49.792991077 (85h29m11.752088326s) [upload=89124]: Starting upload Aug 12 06:54:49.793074725 (85h29m11.752171973s) [upload=89124]: Done starting upload Aug 12 06:54:49.793154543 (85h29m11.752251774s) [upload=89124]: Uploading segments... Aug 12 06:54:49.793257128 (85h29m11.752354361s) [upload=89124]: Got next segment. Inline: true Aug 12 06:54:49.793263699 (85h29m11.752360947s) [upload=89124]: Waiting for error group managing segments... Aug 12 06:54:49.793328998 (85h29m11.752426231s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 06:54:49.793335241 (85h29m11.752432489s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 06:54:49.793338782 (85h29m11.752436028s) [upload=89124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 06:54:49.897616555 (85h29m11.856713789s) [upload=89124]: Done uploading segments... Aug 12 06:54:49.897639697 (85h29m11.856736928s) [upload=89124]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.490141ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|