Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X................................................X] duration:
367.007152ms
FAIL (2025-08-15 04:36:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:36:40.680967617 (155h11m2.640064868s) [upload=161643]: Starting upload Aug 15 04:36:40.681076953 (155h11m2.640174216s) [upload=161643]: Done starting upload Aug 15 04:36:40.681217161 (155h11m2.640314415s) [upload=161643]: Uploading segments... Aug 15 04:36:40.681353043 (155h11m2.640450302s) [upload=161643]: Got next segment. Inline: true Aug 15 04:36:40.681360176 (155h11m2.64045743s) [upload=161643]: Waiting for error group managing segments... Aug 15 04:36:40.681450275 (155h11m2.640547538s) [upload=161643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:36:40.681457235 (155h11m2.640554486s) [upload=161643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:36:40.681461399 (155h11m2.64055865s) [upload=161643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:36:40.772015426 (155h11m2.731112671s) [upload=161643]: Done uploading segments... Aug 15 04:36:40.772035869 (155h11m2.731133116s) [upload=161643]: Upload finished. err: metaclient: Too Many Requests
Duration: 367.032501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
994.819998ms
FAIL (2025-08-15 04:36:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 994.847456ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.................................X..............] duration:
2.506320062s
FAIL (2025-08-15 04:36:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.506376093s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.................................X.............] duration:
2.341899444s
FAIL (2025-08-15 04:35:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.341927482s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.026021271s
FAIL (2025-08-15 04:35:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.026046019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.................................X............] duration:
2.434515112s
FAIL (2025-08-15 04:35:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.434547959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
813.336979ms
FAIL (2025-08-15 04:34:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.371476ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.................................X...........] duration:
2.278162492s
FAIL (2025-08-15 04:34:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.278258996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
812.130832ms
FAIL (2025-08-15 04:34:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 812.162862ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.................................X..........] duration:
2.464720033s
FAIL (2025-08-15 04:33:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.464768496s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
852.791416ms
FAIL (2025-08-15 04:33:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.832155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.................................X.........] duration:
2.811610594s
FAIL (2025-08-15 04:33:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.811646397s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
841.380241ms
FAIL (2025-08-15 04:33:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.414954ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.................................X........] duration:
2.608595783s
FAIL (2025-08-15 04:32:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.608633924s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.014336105s
FAIL (2025-08-15 04:32:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.014383218s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.018573128s
FAIL (2025-08-15 04:31:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.018609167s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.................................X.......] duration:
2.43946705s
FAIL (2025-08-15 04:31:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.439497465s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
896.678756ms
FAIL (2025-08-15 04:30:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 896.77616ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.................................X......] duration:
2.358105747s
FAIL (2025-08-15 04:30:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.358203446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.059341899s
FAIL (2025-08-15 04:30:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.05938766s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.................................X.....] duration:
2.472631359s
FAIL (2025-08-15 04:29:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.47265853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X....................X......................................] duration:
1.088031703s
FAIL (2025-08-15 04:29:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.088068856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.................................X....] duration:
2.339991555s
FAIL (2025-08-15 04:28:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.340020702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X....................X.....................................] duration:
833.810461ms
FAIL (2025-08-15 04:28:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.921597ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X.................................X...] duration:
2.737401794s
FAIL (2025-08-15 04:28:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.73743575s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X....................X....................................] duration:
1.026011183s
FAIL (2025-08-15 04:27:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.026049547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.................................X..] duration:
2.56132329s
FAIL (2025-08-15 04:27:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.561355819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X....................X...................................] duration:
1.054725519s
FAIL (2025-08-15 04:27:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.05492164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...X....................X..................................] duration:
931.750646ms
FAIL (2025-08-15 04:26:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 931.782512ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X.................................X.] duration:
2.346338505s
FAIL (2025-08-15 04:26:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 2.346404674s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...X....................X.................................] duration:
1.016744867s
FAIL (2025-08-15 04:25:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.016773259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.................................X] duration:
1.826622359s
FAIL (2025-08-15 04:25:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 04:25:26.830287876 (154h59m48.789385122s) [upload=161449]: Starting upload
Aug 15 04:25:26.830373371 (154h59m48.789470616s) [upload=161449]: Done starting upload
Aug 15 04:25:26.830511201 (154h59m48.789608438s) [upload=161449]: Uploading segments...
Aug 15 04:25:26.830850194 (154h59m48.789947441s) [upload=161449]: Got next segment. Inline: false
Aug 15 04:25:26.830925978 (154h59m48.790023229s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 04:25:26.830948912 (154h59m48.790046161s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 04:25:27.064734149 (154h59m49.023831406s) [seg_pos={0 0}, upload=161449]: Begin upload segment...
Aug 15 04:25:27.064820162 (154h59m49.023917409s) [seg_pos={0 0}, upload=161449]: Done begin upload segment.
Aug 15 04:25:27.064860059 (154h59m49.023957314s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.064875491 (154h59m49.023972747s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065298290 (154h59m49.024395606s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065586466 (154h59m49.02468372s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065604474 (154h59m49.024701723s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.065958017 (154h59m49.025055262s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.066192466 (154h59m49.025289721s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070230063 (154h59m49.029327312s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.070831404 (154h59m49.02992866s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071274518 (154h59m49.030371769s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.071681972 (154h59m49.030779228s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072252111 (154h59m49.031349348s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072570648 (154h59m49.031667888s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072633328 (154h59m49.031730583s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.072941188 (154h59m49.03203844s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073198975 (154h59m49.032296213s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073298751 (154h59m49.032396005s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.073692645 (154h59m49.032789892s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Uploading piece...
Aug 15 04:25:27.605539614 (154h59m49.564636863s) [upload=161449]: Next returned nil segment
Aug 15 04:25:27.605563158 (154h59m49.564660414s) [upload=161449]: Waiting for error group managing segments...
Aug 15 04:25:27.760813600 (154h59m49.719910835s) [noise=true , address=77.90.31.10:4552 , piece_id=YSXKBY44AASXI5CCBNADCZZIZ6UYCQPAKBMA5Q4B2Y4BUX6RYUDA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.779793776 (154h59m49.738891019s) [noise=true , address=77.90.31.15:4706 , piece_id=W224ZZQN2T7BDCF6IO3XBIVGPZ5Y6WVHTXE2KKGDAVGKBTHSKOEA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.788289310 (154h59m49.747386548s) [noise=true , address=77.90.31.11:4558 , piece_id=ITCDAK4MJNVTACPZIVNONGJPBZMHLF3AG5WHGQPJ4S3EMTBBM5HQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.789717664 (154h59m49.74881491s) [noise=true , address=45.91.116.12:4252 , piece_id=JRRHFVLMFOTPTL7TEQ5DRKZQOMNXDA3DQIZFOCYRR7J4SARF4BFA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.794595791 (154h59m49.753693038s) [noise=true , address=77.90.31.21:4881 , piece_id=OEK5YUKHJNDBI7ZJTY5B7WRQFMFY5JGORMGSX27ZU32AR4VQKHYA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.805617237 (154h59m49.764714477s) [noise=true , address=104.36.82.51:4056 , piece_id=N2YUQCATTCTRIZ6QCSXOYJ6XW6AKYOD32KFDOUK5ACFZNAYL2NRQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.829650522 (154h59m49.788747758s) [noise=true , address=104.36.82.58:4288 , piece_id=KIUZA5OBF4TXUW3RLWJWJFIK7EIFUCNFSNZY4RYI4DPATPNIDSIQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.831026700 (154h59m49.790123938s) [noise=true , address=79.127.219.38:4016 , piece_id=MGRPA52S6JBXKPCYMDSVD4GXLCZMKFT3QGGOKJZM5VFZBBS4OLPA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.837278178 (154h59m49.796375409s) [noise=true , address=104.36.82.5:4844 , piece_id=XC4XJPDKKBM76SNN3OQRDKUDCRN2V4W6OIFUM4JTO2NE542WIBEQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.839845190 (154h59m49.798942429s) [noise=true , address=104.36.82.51:4057 , piece_id=DTVH2M4UIDTNIIWIV66TKMQZLWJPGELFKAEBOZ6SDFYASPDFZNLQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.842662242 (154h59m49.801759479s) [noise=true , address=104.36.82.44:4875 , piece_id=7EFO2732HXYYNKUIV43Q5FKHEMLXL5QSAXBMRAMLCGOCU4C36X6A, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.848581146 (154h59m49.807678378s) [noise=true , address=104.36.82.60:4357 , piece_id=OC4SV7OUXI2LL4UPWOLUDX7NJJT3RUAX3HJEKPKLZTN77KF27GPQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.862255566 (154h59m49.821352811s) [noise=true , address=104.36.82.23:4470 , piece_id=FMYICVB672ASZP3RUO3MHJ7K5ERB5LRW3SAWOIC7D3TIYDTEANKQ, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889295574 (154h59m49.848392812s) [noise=true , address=104.36.82.36:4624 , piece_id=OWAPUNG23S27IYB7FWNJR53UJD63QGFLG7MIJ5YDKSUT77DHRLSA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: <nil>
Aug 15 04:25:27.889340471 (154h59m49.848437716s) [seg_pos={0 0}, upload=161449]: Segment reached optimal threshold of 14 pieces.
Aug 15 04:25:27.889540243 (154h59m49.848637489s) [noise=true , address=79.127.201.215:4347 , piece_id=XLF46QGUPP4B5MQTWTS56ZLBNGZWIISJBB5RIINMNTPYZBXEXXGA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889625686 (154h59m49.848722932s) [noise=true , address=66.23.193.175:4558 , piece_id=MRSQSZSBE2V4OXJWQI6S2HGT3UXT5JREWHE24R4CVIQD37ORFSUA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51150->66.23.193.175:4558: use of closed network connection
Aug 15 04:25:27.889651454 (154h59m49.84874869s) [noise=true , address=79.127.220.101:4066 , piece_id=47HSQTYUM3ASOZCYC66334C2V4BEZOFYMPTSRRKP2TSMT6HZG5GA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 15 04:25:27.889778068 (154h59m49.848875306s) [noise=true , address=64.49.13.140:4511 , piece_id=BJG6XRK6F4A3NFQ32X4Z2UHF6QDS5CWAX32RVV4C6PDXVHZZ5RCA, seg_pos={0 0}, upload=161449]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60900->64.49.13.140:4511: use of closed network connection
Aug 15 04:25:27.889811771 (154h59m49.848909022s) [seg_pos={0 0}, upload=161449]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 04:25:27.889951051 (154h59m49.849048296s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 04:25:27.889956761 (154h59m49.849054006s) [upload=161449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 04:25:28.062984966 (154h59m50.022082211s) [upload=161449]: Done uploading segments...
Aug 15 04:25:28.063005315 (154h59m50.022102551s) [upload=161449]: Upload finished. err: <nil>
Duration: 1.826733808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...X....................X................................] duration:
954.913069ms
FAIL (2025-08-15 04:24:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 954.944509ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.42122391s
FAIL (2025-08-15 04:24:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.421261386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...X....................X...............................] duration:
826.84844ms
FAIL (2025-08-15 04:23:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.898945ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.436843337s
FAIL (2025-08-15 04:23:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.436898002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.501556179s
FAIL (2025-08-15 04:22:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.50164595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...X....................X..............................] duration:
1.075843175s
FAIL (2025-08-15 04:22:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.075878669s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.71392134s
FAIL (2025-08-15 04:22:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.713962792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...X....................X.............................] duration:
829.65696ms
FAIL (2025-08-15 04:22:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.685641ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...X....................X............................] duration:
863.331596ms
FAIL (2025-08-15 04:22:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.369897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...X....................X...........................] duration:
860.205485ms
FAIL (2025-08-15 04:21:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 860.233536ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.56841759s
FAIL (2025-08-15 04:21:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.568454303s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...X....................X..........................] duration:
947.725782ms
FAIL (2025-08-15 04:20:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 947.757147ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.384780488s
FAIL (2025-08-15 04:20:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.384813598s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...X....................X.........................] duration:
852.903819ms
FAIL (2025-08-15 04:20:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.953026ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...X....................X........................] duration:
1.045314069s
FAIL (2025-08-15 04:19:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.045345873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.36312787s
FAIL (2025-08-15 04:19:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.363164254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.440114869s
FAIL (2025-08-15 04:18:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 03:59:57.875027307 (154h34m19.834124553s) [upload=161010]: Starting upload
Aug 15 03:59:57.875099273 (154h34m19.834196512s) [upload=161010]: Done starting upload
Aug 15 03:59:57.875412935 (154h34m19.834510172s) [upload=161010]: Uploading segments...
Aug 15 03:59:57.875470108 (154h34m19.834567362s) [upload=161010]: Got next segment. Inline: false
Aug 15 03:59:57.875500721 (154h34m19.834597967s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 03:59:57.875659132 (154h34m19.834756376s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 03:59:58.079644307 (154h34m20.038741552s) [seg_pos={0 0}, upload=161010]: Begin upload segment...
Aug 15 03:59:58.079691807 (154h34m20.038789052s) [seg_pos={0 0}, upload=161010]: Done begin upload segment.
Aug 15 03:59:58.079715185 (154h34m20.03881243s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080167460 (154h34m20.03926471s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080488740 (154h34m20.039585985s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.080786711 (154h34m20.039883957s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081099555 (154h34m20.0401968s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081429436 (154h34m20.040526682s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081691128 (154h34m20.040788376s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.081947782 (154h34m20.04104503s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082271595 (154h34m20.041368849s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.082697428 (154h34m20.041794679s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083062392 (154h34m20.042159642s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083462624 (154h34m20.042559881s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.083963750 (154h34m20.043061006s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084393416 (154h34m20.043490674s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.084872305 (154h34m20.043969571s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085369638 (154h34m20.044466891s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.085812813 (154h34m20.044910069s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.086362041 (154h34m20.045459291s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Uploading piece...
Aug 15 03:59:58.664761819 (154h34m20.623859051s) [upload=161010]: Next returned nil segment
Aug 15 03:59:58.664780608 (154h34m20.623877856s) [upload=161010]: Waiting for error group managing segments...
Aug 15 03:59:58.817184606 (154h34m20.77628185s) [noise=true , address=77.90.31.17:4803 , piece_id=3DQ422T53IYTHICQ44Q7FU2X5ZGGOU3A4ZOZFVO7WA6VEPLYY6VQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.824743289 (154h34m20.78384052s) [noise=true , address=104.36.82.56:4249 , piece_id=GIGQKEIL3MOFQMHJZERIZ4PRX2ODU3UDEY3BQ7BMJD6TSW2AE7LQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.827781694 (154h34m20.786878937s) [noise=true , address=77.90.31.11:4584 , piece_id=5RZISRJ3XA2JT2P5STF6BZPKBLSXX6XY67XLINEKXRU76YZLSMQA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.830280864 (154h34m20.789378104s) [noise=true , address=104.36.82.10:4096 , piece_id=SJKQXGPS7GCBEHPX257HKHZXFDPERHOIRCIWVJHOSOFBEDNOZDGA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.831417603 (154h34m20.790514849s) [noise=true , address=104.36.82.58:4268 , piece_id=OWITMWAI5JQCQHUQSXGJLIGKKLIGX43G2UBSRYA6W7F4UNTHW5WA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.835661700 (154h34m20.79475896s) [noise=true , address=104.36.82.61:4400 , piece_id=L6VLGPNER3WZB3JSEADBUFO2C7BFDNQFGUGYU6KL7CIALXCR6BNQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.838171324 (154h34m20.797268569s) [noise=true , address=77.90.31.16:4742 , piece_id=HZVHQR7A5QCMULPDA2SB7CG5PKITTLAMQ44JZOVXDEIGRKRK6L7A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.845574185 (154h34m20.80467143s) [noise=true , address=45.91.116.14:4199 , piece_id=3OUTXA4FNI7TWVSUL2A5ES2V3XJLS5FKSUW5PHTCY62SLASY3QXA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.855232868 (154h34m20.814330103s) [noise=true , address=104.36.82.4:4812 , piece_id=ZWGHNPYQPMF77UERQSHHO4PWTGLV3JQTW55WMJ6WOWPE22GRP5BA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.863014896 (154h34m20.822112143s) [noise=true , address=104.36.82.17:4357 , piece_id=MKG72RG2ZVC4FELVPZR2OZY4KK6EPXYLXPKEYP4LD76FPMEFIEWQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.872452190 (154h34m20.831549438s) [noise=true , address=104.36.82.60:4340 , piece_id=X3U6EKME3NXVEWVWALYSCEOVYL66BFJZFYN22R7PSECTPBOOFS4A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.876687383 (154h34m20.835784629s) [noise=true , address=77.90.31.14:4688 , piece_id=CXYFVGDVMT7JJB7WVOZPWLGHOMXFSPSNMPZPOFJ6FD7EGR4ZJGDQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890311196 (154h34m20.849408435s) [noise=true , address=104.36.82.41:4781 , piece_id=DMG2X7KKEICIWUU5YIRS3PNNK6MZLRGCMPBIILTVBY2O2XDMY2XA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890900901 (154h34m20.849998148s) [noise=true , address=77.90.31.19:4859 , piece_id=YUGZBF7LOIV2B2L37WKRQWWWHPOEG7K2EIZCMCTOKV6D7F74BDPA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: <nil>
Aug 15 03:59:58.890924747 (154h34m20.850021993s) [seg_pos={0 0}, upload=161010]: Segment reached optimal threshold of 14 pieces.
Aug 15 03:59:58.891133330 (154h34m20.850230576s) [noise=true , address=104.36.82.38:4704 , piece_id=EA4CVKOK4ZHGHRZYV22C5KU2YDPVNI6LZWVOLIVHLSZFK2UP7EQQ, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1225CoSQvGuiWjJZWaXhvvq4gxzMymZqUb9fBrfLWw4RekwAEhp): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891345330 (154h34m20.850442577s) [noise=true , address=77.90.31.13:4652 , piece_id=7JZETFQUKGJJRAPCLZ6XWBXM3FYTDIOYVA6VA4R6F4YHPHJQOSCA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891474295 (154h34m20.850571542s) [noise=true , address=104.36.82.8:4978 , piece_id=7NQBHN5YQI5WEOZCSPKV4CXPDOZKIVXJNHTEG3E2UWAFU5XO4R2A, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891755794 (154h34m20.85085304s) [noise=true , address=79.127.220.101:4076 , piece_id=V5DI6SKAYELFL3VVE4YLNLS7MNO4H4W5IYLMMI4X33UBQZJGAMVA, seg_pos={0 0}, upload=161010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: expected piece hash; context canceled; EOF
Aug 15 03:59:58.891818626 (154h34m20.850915882s) [seg_pos={0 0}, upload=161010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 03:59:58.891925158 (154h34m20.8510224s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 03:59:58.891946658 (154h34m20.851043906s) [upload=161010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 03:59:59.056134941 (154h34m21.015232185s) [upload=161010]: Done uploading segments...
Aug 15 03:59:59.056166899 (154h34m21.01526413s) [upload=161010]: Upload finished. err: <nil>
Duration: 2.44016939s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...X....................X.......................] duration:
813.652464ms
FAIL (2025-08-15 04:18:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 04:01:39.549641884 (154h36m1.508739129s) [upload=161040]: Starting upload Aug 15 04:01:39.549685088 (154h36m1.508782342s) [upload=161040]: Done starting upload Aug 15 04:01:39.549750038 (154h36m1.50884727s) [upload=161040]: Uploading segments... Aug 15 04:01:39.549795174 (154h36m1.508892425s) [upload=161040]: Got next segment. Inline: true Aug 15 04:01:39.549800335 (154h36m1.508897565s) [upload=161040]: Waiting for error group managing segments... Aug 15 04:01:39.549838852 (154h36m1.508936083s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 04:01:39.549843528 (154h36m1.50894076s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 04:01:39.549846488 (154h36m1.508943734s) [upload=161040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 04:01:39.638286007 (154h36m1.597383252s) [upload=161040]: Done uploading segments... Aug 15 04:01:39.638304848 (154h36m1.597402083s) [upload=161040]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.688159ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|