Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X...............X.........X.......XX......X.] duration:
2.541577258s
FAIL (2025-08-19 09:36:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:35:43.459648952 (256h10m5.418746188s) [upload=266687]: Starting upload Aug 19 09:35:43.459723390 (256h10m5.418820635s) [upload=266687]: Done starting upload Aug 19 09:35:43.459829618 (256h10m5.418926856s) [upload=266687]: Uploading segments... Aug 19 09:35:43.460210088 (256h10m5.419307325s) [upload=266687]: Got next segment. Inline: false Aug 19 09:35:43.460275585 (256h10m5.41937283s) [upload=266687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:35:43.460281112 (256h10m5.419378357s) [upload=266687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:35:43.548407812 (256h10m5.507505071s) [upload=266687]: Next segment err: metaclient: Too Many Requests Aug 19 09:35:43.548443960 (256h10m5.507541208s) [upload=266687]: Done uploading segments... Aug 19 09:35:43.548471097 (256h10m5.507568344s) [upload=266687]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.541612688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........XX.X.................X...X..................X.......] duration:
3.995152838s
FAIL (2025-08-19 09:36:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.995221402s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................X...............X.........X.......XX......X] duration:
369.415194ms
FAIL (2025-08-19 09:35:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:35:43.459648952 (256h10m5.418746188s) [upload=266687]: Starting upload Aug 19 09:35:43.459723390 (256h10m5.418820635s) [upload=266687]: Done starting upload Aug 19 09:35:43.459829618 (256h10m5.418926856s) [upload=266687]: Uploading segments... Aug 19 09:35:43.460210088 (256h10m5.419307325s) [upload=266687]: Got next segment. Inline: false Aug 19 09:35:43.460275585 (256h10m5.41937283s) [upload=266687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:35:43.460281112 (256h10m5.419378357s) [upload=266687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:35:43.548407812 (256h10m5.507505071s) [upload=266687]: Next segment err: metaclient: Too Many Requests Aug 19 09:35:43.548443960 (256h10m5.507541208s) [upload=266687]: Done uploading segments... Aug 19 09:35:43.548471097 (256h10m5.507568344s) [upload=266687]: Upload finished. err: metaclient: Too Many Requests
Duration: 369.446545ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........XX.X.................X...X..................X......] duration:
823.630571ms
FAIL (2025-08-19 09:35:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.722257ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X...............X.........X.......XX......] duration:
2.37547785s
FAIL (2025-08-19 09:34:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 2.375514128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........XX.X.................X...X..................X.....] duration:
820.202607ms
FAIL (2025-08-19 09:34:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.319736ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X...............X.........X.......XX.....] duration:
2.421868185s
FAIL (2025-08-19 09:34:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 2.423108751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X..........XX.X.................X...X..................X....] duration:
854.578594ms
FAIL (2025-08-19 09:33:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.618396ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X...............X.........X.......XX....] duration:
2.562972791s
FAIL (2025-08-19 09:33:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 2.563033565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X..........XX.X.................X...X..................X...] duration:
1.419663703s
FAIL (2025-08-19 09:32:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.419698604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X...............X.........X.......XX...] duration:
3.626161659s
FAIL (2025-08-19 09:32:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 3.626192873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X..........XX.X.................X...X..................X..] duration:
837.944679ms
FAIL (2025-08-19 09:31:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.982051ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X...............X.........X.......XX..] duration:
2.525070304s
FAIL (2025-08-19 09:31:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 2.525106044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X..........XX.X.................X...X..................X.] duration:
1.304424303s
FAIL (2025-08-19 09:31:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.304465688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X..........XX.X.................X...X..................X] duration:
363.013115ms
FAIL (2025-08-19 09:31:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:31:17.919411946 (256h5m39.878509213s) [upload=266614]: Starting upload Aug 19 09:31:17.919555891 (256h5m39.878653131s) [upload=266614]: Done starting upload Aug 19 09:31:17.919707297 (256h5m39.878804543s) [upload=266614]: Uploading segments... Aug 19 09:31:17.919809740 (256h5m39.878906995s) [upload=266614]: Got next segment. Inline: true Aug 19 09:31:17.919818893 (256h5m39.878916148s) [upload=266614]: Waiting for error group managing segments... Aug 19 09:31:17.919900444 (256h5m39.878997698s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:31:17.919908292 (256h5m39.879005545s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:31:17.919912298 (256h5m39.879009551s) [upload=266614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:31:18.009247394 (256h5m39.968344654s) [upload=266614]: Done uploading segments... Aug 19 09:31:18.009276999 (256h5m39.968374259s) [upload=266614]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.049931ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X...............X.........X.......XX.] duration:
2.369874738s
FAIL (2025-08-19 09:30:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 2.369908457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........................X...............X.........X.......XX] duration:
1.670786947s
FAIL (2025-08-19 09:30:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 09:30:17.322221743 (256h4m39.281318992s) [upload=266599]: Starting upload
Aug 19 09:30:17.322304575 (256h4m39.281401825s) [upload=266599]: Done starting upload
Aug 19 09:30:17.322476612 (256h4m39.28157386s) [upload=266599]: Uploading segments...
Aug 19 09:30:17.322845912 (256h4m39.281943159s) [upload=266599]: Got next segment. Inline: false
Aug 19 09:30:17.322925689 (256h4m39.282022936s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:30:17.322932816 (256h4m39.282030067s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:30:17.524293541 (256h4m39.483390793s) [seg_pos={0 0}, upload=266599]: Begin upload segment...
Aug 19 09:30:17.524368079 (256h4m39.483465331s) [seg_pos={0 0}, upload=266599]: Done begin upload segment.
Aug 19 09:30:17.524404926 (256h4m39.483502182s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.524446347 (256h4m39.483543602s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525163601 (256h4m39.484260856s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525192342 (256h4m39.484289609s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.525787769 (256h4m39.484885024s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526337433 (256h4m39.48543469s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526349224 (256h4m39.485446503s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526756305 (256h4m39.485853557s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.526815253 (256h4m39.485912508s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527140840 (256h4m39.486238096s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527532770 (256h4m39.486630025s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.527924457 (256h4m39.487021713s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528328364 (256h4m39.487425622s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.528747013 (256h4m39.48784427s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529002943 (256h4m39.488100222s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529446760 (256h4m39.488544016s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.529846983 (256h4m39.488944247s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:17.530279916 (256h4m39.489377173s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Uploading piece...
Aug 19 09:30:18.096834743 (256h4m40.055931999s) [upload=266599]: Next returned nil segment
Aug 19 09:30:18.096856085 (256h4m40.055953344s) [upload=266599]: Waiting for error group managing segments...
Aug 19 09:30:18.234233714 (256h4m40.193330953s) [noise=true , address=77.90.31.13:4651 , piece_id=BHTZEORUDSDNHVGWF7VYJPIHI3DRZ23TDYCSUIP4M4IS7YDLLEXQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.235017548 (256h4m40.194114799s) [noise=true , address=77.90.31.19:4858 , piece_id=HGEA25LWGBU6PB4H5IMCMLQECKPUJRHTRXR64DUQEU6BM3G4USLQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.242828210 (256h4m40.201925459s) [noise=true , address=104.36.82.60:4353 , piece_id=A7BRAT23FZWZOLI274G7I5VNQN4KDCRIRHQESO4QZAGHE4SQ7CAA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.243012603 (256h4m40.202109835s) [noise=true , address=45.91.116.13:4186 , piece_id=PIEDECC5YGXOZOBG5T4NSD6UVJDANPUWM2IKA24F6Q2SBBW35VJQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.244256228 (256h4m40.203353461s) [noise=true , address=77.90.31.12:4615 , piece_id=B3CC7MTAKGPUM7XPTCF7SJG7ZA73HRBVDL35AQLNV3HGLHOZ3HUA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.253468455 (256h4m40.212565693s) [noise=true , address=45.91.116.5:4316 , piece_id=E47LSMXFONELVHRCQUMD2PY4NLA5N626DVAESO2GBUEAGAAIVNFQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.254435126 (256h4m40.213532378s) [noise=true , address=45.91.116.8:4061 , piece_id=TLPFAK27FLFFKBFLPWKG3TFLBI6JLZLBFHKXT4QBB4RCGCGVUG6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.255063287 (256h4m40.214160537s) [noise=true , address=45.91.116.7:4019 , piece_id=YPISEM3WOFVY4EOVGJJUJQJGNQUFCRHHXAD5NIGVFVWYBX7V3TNA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.264828962 (256h4m40.223926202s) [noise=true , address=45.91.116.11:4147 , piece_id=ASY7YTTHFSPNIPEEZW4G5GECIFXEBKEAQVJBAAKZHEOA5FP2PEWQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.275497248 (256h4m40.234594499s) [noise=true , address=104.36.82.5:4849 , piece_id=466UNJH7NJKWRYRBI3C74NTUWX5D2Z2MXY6HJIMKEQ4I4M2OM3FA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.283524862 (256h4m40.2426221s) [noise=true , address=77.90.31.14:4686 , piece_id=HXBOZLHGMW55BGVZNVKJRMZZQKXZCGKFVTSUNZFAXK7D3VGXSNEQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.306866507 (256h4m40.265963755s) [noise=true , address=77.90.31.15:4717 , piece_id=A2OVK4FOHVE275437OH3M4ZT4GIBSDZSX5OSDGK6W3MPZP2YVB7Q, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.320977413 (256h4m40.280074664s) [noise=true , address=77.90.31.16:4745 , piece_id=WNOGLY2ZB4MLNDY5SN4JU6NXJ6JYJWV2LFU33MDDGOB25SAHTZKQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353284719 (256h4m40.312381951s) [noise=true , address=77.90.31.21:4907 , piece_id=RT75PQTDN4SJRVAUI7EK74T6G67AAAVLPAZHERNBTPKFYYNJBPOQ, seg_pos={0 0}, upload=266599]: Done uploading piece. err: <nil>
Aug 19 09:30:18.353348017 (256h4m40.312445264s) [seg_pos={0 0}, upload=266599]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:30:18.353585055 (256h4m40.31268231s) [noise=true , address=77.90.31.17:4801 , piece_id=7HP75ZXSERLUX3F45D22QHOBXT3ZVSBW3KYO6RFZRFK2Q2O2DEEA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353654891 (256h4m40.312752124s) [noise=true , address=79.127.201.215:4355 , piece_id=RWY3YZRQDGOPVOCISBCB47EJHJE4POM4ICSBK3XTIYVZ5FASKKGA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353689955 (256h4m40.312787209s) [noise=true , address=66.23.193.175:4561 , piece_id=OXH7UKEAM5UKNYKO2Y4CUQ43VNGXRYBZMRYUHVYIN5Q6YDU6LPRA, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35770->66.23.193.175:4561: use of closed network connection
Aug 19 09:30:18.353829664 (256h4m40.312926912s) [noise=true , address=79.127.220.98:4430 , piece_id=MFCZJ3XFVM66H6BC5S3X6R5WV4SBGFL37NBCHJAKB53QL4HNPO6A, seg_pos={0 0}, upload=266599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZzD2zUGz3ZHkmBDLxHFxTrtFL5qQxvzbdTehPzzbT4m7DFGLc): protocol: expected piece hash; context canceled; EOF
Aug 19 09:30:18.353871505 (256h4m40.312968739s) [seg_pos={0 0}, upload=266599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:30:18.354000150 (256h4m40.313097403s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:30:18.354037291 (256h4m40.313134542s) [upload=266599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:30:18.515774036 (256h4m40.474871291s) [upload=266599]: Done uploading segments...
Aug 19 09:30:18.515801569 (256h4m40.474898817s) [upload=266599]: Upload finished. err: <nil>
Duration: 1.670884658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..........XX.X.................X...X..................] duration:
830.963218ms
FAIL (2025-08-19 09:30:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 831.017345ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X...............X.........X.......X] duration:
363.622731ms
FAIL (2025-08-19 09:29:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:29:55.082753177 (256h4m17.04185043s) [upload=266593]: Starting upload Aug 19 09:29:55.082837886 (256h4m17.041935126s) [upload=266593]: Done starting upload Aug 19 09:29:55.083016682 (256h4m17.042113926s) [upload=266593]: Uploading segments... Aug 19 09:29:55.083197687 (256h4m17.042294934s) [upload=266593]: Got next segment. Inline: false Aug 19 09:29:55.083261197 (256h4m17.042358443s) [upload=266593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:29:55.083267046 (256h4m17.042364295s) [upload=266593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:29:55.172994637 (256h4m17.132091892s) [upload=266593]: Next segment err: metaclient: Too Many Requests Aug 19 09:29:55.173024980 (256h4m17.132122213s) [upload=266593]: Done uploading segments... Aug 19 09:29:55.173063491 (256h4m17.132160747s) [upload=266593]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.649693ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X...............X.........X.......] duration:
3.80749253s
FAIL (2025-08-19 09:29:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.807526408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..........XX.X.................X...X.................] duration:
850.204111ms
FAIL (2025-08-19 09:29:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 850.25938ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X...............X.........X......] duration:
3.567272535s
FAIL (2025-08-19 09:28:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.567313745s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X...............X.........X.....] duration:
2.378466389s
FAIL (2025-08-19 09:28:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.378506179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..........XX.X.................X...X................] duration:
2.77155162s
FAIL (2025-08-19 09:28:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 2.771578458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............................X...............X.........X....] duration:
2.83034909s
FAIL (2025-08-19 09:27:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.830393582s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..........XX.X.................X...X...............] duration:
1.509000611s
FAIL (2025-08-19 09:27:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 1.509028574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............................X...............X.........X...] duration:
2.82966739s
FAIL (2025-08-19 09:26:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.829703886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X............................X...............X.........X..] duration:
2.642052203s
FAIL (2025-08-19 09:26:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.642105384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X..........XX.X.................X...X..............] duration:
1.027396342s
FAIL (2025-08-19 09:26:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 1.027428013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X..........XX.X.................X...X.............] duration:
1.005531499s
FAIL (2025-08-19 09:25:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 1.005587725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X..........XX.X.................X...X............] duration:
815.207235ms
FAIL (2025-08-19 09:25:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 815.242527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............................X...............X.........X.] duration:
2.288017723s
FAIL (2025-08-19 09:25:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.288047644s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............................X...............X.........X] duration:
358.150676ms
FAIL (2025-08-19 09:24:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:24:43.194786912 (255h59m5.153884151s) [upload=266493]: Starting upload Aug 19 09:24:43.194851298 (255h59m5.153948547s) [upload=266493]: Done starting upload Aug 19 09:24:43.195024953 (255h59m5.154122203s) [upload=266493]: Uploading segments... Aug 19 09:24:43.195230773 (255h59m5.154328041s) [upload=266493]: Got next segment. Inline: false Aug 19 09:24:43.195306515 (255h59m5.154403764s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:24:43.195314688 (255h59m5.154411934s) [upload=266493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:24:43.282594202 (255h59m5.241691438s) [upload=266493]: Next segment err: metaclient: Too Many Requests Aug 19 09:24:43.282630471 (255h59m5.241727718s) [upload=266493]: Done uploading segments... Aug 19 09:24:43.282650650 (255h59m5.241747889s) [upload=266493]: Upload finished. err: metaclient: Too Many Requests
Duration: 358.179426ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X..........XX.X.................X...X...........] duration:
1.047655885s
FAIL (2025-08-19 09:24:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 1.047698442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X............................X...............X.........] duration:
3.030435908s
FAIL (2025-08-19 09:24:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.030469935s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X..........XX.X.................X...X..........] duration:
820.515667ms
FAIL (2025-08-19 09:23:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 820.633062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X............................X...............X........] duration:
2.715350623s
FAIL (2025-08-19 09:23:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.715389255s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..............X..........XX.X.................X...X.........] duration:
802.909638ms
FAIL (2025-08-19 09:23:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 803.004468ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X............................X...............X.......] duration:
3.319193754s
FAIL (2025-08-19 09:22:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.319228856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...............X..........XX.X.................X...X........] duration:
863.695382ms
FAIL (2025-08-19 09:22:30 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 863.729023ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X...............X..........XX.X.................X...X.......] duration:
845.412666ms
FAIL (2025-08-19 09:22:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 845.459327ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X............................X...............X......] duration:
2.341720015s
FAIL (2025-08-19 09:21:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.341751235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X...............X..........XX.X.................X...X......] duration:
851.355428ms
FAIL (2025-08-19 09:21:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 851.402005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X...............X..........XX.X.................X...X.....] duration:
824.142285ms
FAIL (2025-08-19 09:20:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 824.251888ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X............................X...............X.....] duration:
3.941123105s
FAIL (2025-08-19 09:20:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.941156065s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X...............X..........XX.X.................X...X....] duration:
819.330146ms
FAIL (2025-08-19 09:20:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 819.363371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X...X...............X..........XX.X.................X...X...] duration:
962.787767ms
FAIL (2025-08-19 09:19:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 962.818076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X............................X...............X....] duration:
2.532939993s
FAIL (2025-08-19 09:19:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.533001705s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.X...X...............X..........XX.X.................X...X..] duration:
893.494618ms
FAIL (2025-08-19 09:19:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 893.526709ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X............................X...............X...] duration:
2.355723835s
FAIL (2025-08-19 09:18:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.355760393s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|