Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
823.125359ms
FAIL (2025-08-11 02:21:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.153325ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X........X............................] duration:
2.299730832s
FAIL (2025-08-11 02:20:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.299763771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
847.409862ms
FAIL (2025-08-11 02:20:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.439567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X........X...........................] duration:
2.462996254s
FAIL (2025-08-11 02:19:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.463024714s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
864.23449ms
FAIL (2025-08-11 02:19:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.261702ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X........X..........................] duration:
2.407839327s
FAIL (2025-08-11 02:19:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.407904351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X........X.........................] duration:
2.347594s
FAIL (2025-08-11 02:18:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.347620173s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
828.868239ms
FAIL (2025-08-11 02:18:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.89211ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X........X........................] duration:
2.393722896s
FAIL (2025-08-11 02:18:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.393853373s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X........X.......................] duration:
2.456985309s
FAIL (2025-08-11 02:17:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.457013851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.009016759s
FAIL (2025-08-11 02:17:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.009045234s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X........X......................] duration:
2.497932723s
FAIL (2025-08-11 02:17:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.497966958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
834.153004ms
FAIL (2025-08-11 02:17:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.176562ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X........X.....................] duration:
2.387270412s
FAIL (2025-08-11 02:17:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.387372235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
844.587377ms
FAIL (2025-08-11 02:16:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.623659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..............................................X............] duration:
844.56983ms
FAIL (2025-08-11 02:16:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.604914ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X........X....................] duration:
2.446933656s
FAIL (2025-08-11 02:16:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.446984159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..............................................X...........] duration:
902.124496ms
FAIL (2025-08-11 02:15:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.153991ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........X...................] duration:
2.359357479s
FAIL (2025-08-11 02:14:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.359391437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X........X..................] duration:
2.357894473s
FAIL (2025-08-11 02:14:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.357926574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..............................................X..........] duration:
951.269874ms
FAIL (2025-08-11 02:14:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 951.298172ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........X.................] duration:
2.972895267s
FAIL (2025-08-11 02:13:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.972920663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........X................] duration:
2.697220374s
FAIL (2025-08-11 02:13:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.697244065s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..............................................X.........] duration:
855.43101ms
FAIL (2025-08-11 02:13:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.459765ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X........X...............] duration:
2.377280228s
FAIL (2025-08-11 02:12:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.377310985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..............................................X........] duration:
839.753491ms
FAIL (2025-08-11 02:12:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.782648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X........X..............] duration:
2.387239084s
FAIL (2025-08-11 02:12:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.387272463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X........X.............] duration:
2.378962024s
FAIL (2025-08-11 02:11:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.378994464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration:
824.890047ms
FAIL (2025-08-11 02:11:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.985458ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..............................................X......] duration:
996.579493ms
FAIL (2025-08-11 02:11:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 996.742658ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X........X............] duration:
2.344270139s
FAIL (2025-08-11 02:10:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.344302323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............................................X.....] duration:
861.370791ms
FAIL (2025-08-11 02:10:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.50412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X........X...........] duration:
2.682291631s
FAIL (2025-08-11 02:09:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.682344764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..............................................X....] duration:
879.261643ms
FAIL (2025-08-11 02:08:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.285689ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X........X..........] duration:
2.379225312s
FAIL (2025-08-11 02:08:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.379259755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration:
2.458168506s
FAIL (2025-08-11 02:08:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.458203174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..............................................X...] duration:
861.160561ms
FAIL (2025-08-11 02:08:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.193412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X........X........] duration:
2.378867336s
FAIL (2025-08-11 02:07:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.378911323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X..............................................X..] duration:
844.695165ms
FAIL (2025-08-11 02:07:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.727906ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..............................................X.] duration:
887.292151ms
FAIL (2025-08-11 02:07:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.323666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration:
2.591776229s
FAIL (2025-08-11 02:07:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.591810669s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X..............................................X] duration:
360.070426ms
FAIL (2025-08-11 02:06:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 02:06:17.917005506 (56h40m39.876102741s) [upload=59063]: Starting upload Aug 11 02:06:17.917077704 (56h40m39.876174949s) [upload=59063]: Done starting upload Aug 11 02:06:17.917201693 (56h40m39.87629893s) [upload=59063]: Uploading segments... Aug 11 02:06:17.917258184 (56h40m39.876355438s) [upload=59063]: Got next segment. Inline: true Aug 11 02:06:17.917263603 (56h40m39.876360848s) [upload=59063]: Waiting for error group managing segments... Aug 11 02:06:17.917320862 (56h40m39.876418098s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 02:06:17.917326117 (56h40m39.876423362s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 02:06:17.917329506 (56h40m39.876426752s) [upload=59063]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 02:06:18.005421695 (56h40m39.964518951s) [upload=59063]: Done uploading segments... Aug 11 02:06:18.005445516 (56h40m39.964542762s) [upload=59063]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.097277ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X........X......] duration:
2.67055638s
FAIL (2025-08-11 02:06:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.670615807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration:
2.431620357s
FAIL (2025-08-11 02:05:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.431653922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
880.099447ms
FAIL (2025-08-11 02:05:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 01:30:28.771421711 (56h4m50.730518956s) [upload=58447]: Starting upload
Aug 11 01:30:28.771476575 (56h4m50.730573823s) [upload=58447]: Done starting upload
Aug 11 01:30:28.771555501 (56h4m50.730652735s) [upload=58447]: Uploading segments...
Aug 11 01:30:28.771593649 (56h4m50.730690904s) [upload=58447]: Got next segment. Inline: true
Aug 11 01:30:28.771599291 (56h4m50.730696537s) [upload=58447]: Waiting for error group managing segments...
Aug 11 01:30:28.771645624 (56h4m50.730742859s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:30:28.771650789 (56h4m50.730748035s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 01:30:28.771654220 (56h4m50.730751466s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:30:29.817938269 (56h4m51.777035535s) [upload=58447]: Done uploading segments...
Aug 11 01:30:29.817958984 (56h4m51.777056222s) [upload=58447]: Upload finished. err: <nil>
Duration: 880.137627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
856.156432ms
FAIL (2025-08-11 02:04:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 01:30:28.771421711 (56h4m50.730518956s) [upload=58447]: Starting upload
Aug 11 01:30:28.771476575 (56h4m50.730573823s) [upload=58447]: Done starting upload
Aug 11 01:30:28.771555501 (56h4m50.730652735s) [upload=58447]: Uploading segments...
Aug 11 01:30:28.771593649 (56h4m50.730690904s) [upload=58447]: Got next segment. Inline: true
Aug 11 01:30:28.771599291 (56h4m50.730696537s) [upload=58447]: Waiting for error group managing segments...
Aug 11 01:30:28.771645624 (56h4m50.730742859s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:30:28.771650789 (56h4m50.730748035s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 01:30:28.771654220 (56h4m50.730751466s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:30:29.817938269 (56h4m51.777035535s) [upload=58447]: Done uploading segments...
Aug 11 01:30:29.817958984 (56h4m51.777056222s) [upload=58447]: Upload finished. err: <nil>
Duration: 856.204572ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....] duration:
2.918369095s
FAIL (2025-08-11 02:04:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.918406588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
845.054109ms
FAIL (2025-08-11 02:04:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 01:30:28.771421711 (56h4m50.730518956s) [upload=58447]: Starting upload
Aug 11 01:30:28.771476575 (56h4m50.730573823s) [upload=58447]: Done starting upload
Aug 11 01:30:28.771555501 (56h4m50.730652735s) [upload=58447]: Uploading segments...
Aug 11 01:30:28.771593649 (56h4m50.730690904s) [upload=58447]: Got next segment. Inline: true
Aug 11 01:30:28.771599291 (56h4m50.730696537s) [upload=58447]: Waiting for error group managing segments...
Aug 11 01:30:28.771645624 (56h4m50.730742859s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:30:28.771650789 (56h4m50.730748035s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 01:30:28.771654220 (56h4m50.730751466s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:30:29.817938269 (56h4m51.777035535s) [upload=58447]: Done uploading segments...
Aug 11 01:30:29.817958984 (56h4m51.777056222s) [upload=58447]: Upload finished. err: <nil>
Duration: 845.093182ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
873.674679ms
FAIL (2025-08-11 02:03:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 01:30:28.771421711 (56h4m50.730518956s) [upload=58447]: Starting upload
Aug 11 01:30:28.771476575 (56h4m50.730573823s) [upload=58447]: Done starting upload
Aug 11 01:30:28.771555501 (56h4m50.730652735s) [upload=58447]: Uploading segments...
Aug 11 01:30:28.771593649 (56h4m50.730690904s) [upload=58447]: Got next segment. Inline: true
Aug 11 01:30:28.771599291 (56h4m50.730696537s) [upload=58447]: Waiting for error group managing segments...
Aug 11 01:30:28.771645624 (56h4m50.730742859s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:30:28.771650789 (56h4m50.730748035s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 01:30:28.771654220 (56h4m50.730751466s) [upload=58447]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:30:29.817938269 (56h4m51.777035535s) [upload=58447]: Done uploading segments...
Aug 11 01:30:29.817958984 (56h4m51.777056222s) [upload=58447]: Upload finished. err: <nil>
Duration: 873.717192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...] duration:
2.539364115s
FAIL (2025-08-11 02:03:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 02:01:12.601003399 (56h35m34.560100644s) [upload=58974]: Starting upload
Aug 11 02:01:12.601070304 (56h35m34.560167558s) [upload=58974]: Done starting upload
Aug 11 02:01:12.601380895 (56h35m34.560478126s) [upload=58974]: Uploading segments...
Aug 11 02:01:12.601437655 (56h35m34.5605349s) [upload=58974]: Got next segment. Inline: false
Aug 11 02:01:12.601470709 (56h35m34.560567953s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 02:01:12.601475520 (56h35m34.560572765s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 02:01:12.800204855 (56h35m34.759302127s) [seg_pos={0 0}, upload=58974]: Begin upload segment...
Aug 11 02:01:12.800412987 (56h35m34.759510233s) [seg_pos={0 0}, upload=58974]: Done begin upload segment.
Aug 11 02:01:12.800476670 (56h35m34.759573919s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801069823 (56h35m34.760167071s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801454739 (56h35m34.760551985s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801791613 (56h35m34.760888858s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.801887870 (56h35m34.760985124s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802443447 (56h35m34.761540682s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.802633105 (56h35m34.761730353s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803277177 (56h35m34.762374422s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.803846870 (56h35m34.762944105s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.804300272 (56h35m34.763397533s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.805723343 (56h35m34.76482059s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806322521 (56h35m34.765419825s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.806747256 (56h35m34.765844503s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807105556 (56h35m34.766202809s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807477718 (56h35m34.76657497s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.807828173 (56h35m34.76692543s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808200124 (56h35m34.76729738s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:12.808647503 (56h35m34.767744758s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Uploading piece...
Aug 11 02:01:13.388725010 (56h35m35.347822256s) [upload=58974]: Next returned nil segment
Aug 11 02:01:13.388747720 (56h35m35.347844957s) [upload=58974]: Waiting for error group managing segments...
Aug 11 02:01:13.538648384 (56h35m35.497745622s) [noise=true , address=104.36.82.14:4251 , piece_id=6Z6G5ROQXYQGPYIHTM2HXAZQ7Y5G5OHEHX4JYCVCOMOTZKMCZB6Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.541884457 (56h35m35.500981705s) [noise=true , address=104.36.82.9:4021 , piece_id=4DP757TUU6C6HJXGRZKM4WQXXNZ6KYJVHEBARVM6AE3YIKOBZCEQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.542765792 (56h35m35.501863039s) [noise=true , address=104.36.82.20:4458 , piece_id=2VHUI4RAAUHCQAEBCZTL6S7VPOR3VZU7LODDR7OYCQSWJH2CEOCA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.543781328 (56h35m35.502878561s) [noise=true , address=104.36.82.46:4513 , piece_id=2NEPKYTFVCUH2EKAULU4IBYPKY2SJNBVYFLV7QAKQ65EDDUP25WA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.546344709 (56h35m35.505441959s) [noise=true , address=104.36.82.44:4882 , piece_id=TG5TVOFHY3NHUUC6VJ5OIX2M27TXF7XRIPMKMPDPW2BPLAPAGRHQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.548172999 (56h35m35.507270243s) [noise=true , address=104.36.82.38:4704 , piece_id=6LQG23UVPUPN6W7YWOQ5UZX7GFOKQ43L4WYEYKN6FJ7YYDG2OISA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.551279692 (56h35m35.510376941s) [noise=true , address=104.36.82.39:4759 , piece_id=V5SLAXQ6NXOZN45NDDXEGRLJDBUL2MMCKYQCZHEN557EVDPZHE2Q, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.555535099 (56h35m35.514632331s) [noise=true , address=104.36.82.43:4868 , piece_id=XSTSCOV3IFCPZQMDXEB6FKM3XA6ZPJ6RD7AWUAYB2R7EXKW3PENA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562598940 (56h35m35.521696178s) [noise=true , address=104.36.82.59:4334 , piece_id=FQ3FBU7D7VUZJGTGKBAVUZKPSSEVUYERY2J3UBRLL6BBVW4IZ6YA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.562685157 (56h35m35.521782404s) [noise=true , address=104.36.82.60:4353 , piece_id=UHKSWX4UR2DFW3SXDJSWFHQG7MYO5Q6YNJVCTW2YSQY252R7JUXQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.576858394 (56h35m35.535955644s) [noise=true , address=104.36.82.47:4526 , piece_id=UMCQUC6ZHICAQABP4J4GJZ5TNA556SMSSKDTOLGBVGZHMOLCP42A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.577225360 (56h35m35.536322594s) [noise=true , address=104.36.82.41:4785 , piece_id=CWTOX6SK4KKAHAPUGM6DT7WXTNPNQFOHDDIQ57CX6ERLLWTHH44A, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.580407334 (56h35m35.539504583s) [noise=true , address=104.36.82.61:4391 , piece_id=E4NMQTH2WF4MR4G2BVHGH3ZBRDBPHDICDN7Q4F2G5O6HVHQVYBPA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590811256 (56h35m35.549908495s) [noise=true , address=104.36.82.23:4445 , piece_id=RJWS7N3TZ3ALQ3B2F4PKOLPP56MCRBHDOWAMMHO2EFYA7HENGPZA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: <nil>
Aug 11 02:01:13.590844477 (56h35m35.549941723s) [seg_pos={0 0}, upload=58974]: Segment reached optimal threshold of 14 pieces.
Aug 11 02:01:13.591135556 (56h35m35.550232794s) [noise=true , address=79.127.220.97:4365 , piece_id=22DS66AVO5QBSJ3OXA3FY4TW2GR725FID6OPJ3GASKRSD2ZMZCVQ, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VjsXDMd7wCseYJV6XFJvonKfeuNf9pkZxje7tPw59Ezwvf829): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591323491 (56h35m35.550420745s) [noise=true , address=104.36.82.60:4340 , piece_id=N23Q3DRT236SHTZ4SWRDE7I6CGITVG46SCG2QF4BUIDBIBVTKLHA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 02:01:13.591635007 (56h35m35.550732242s) [noise=true , address=64.49.13.137:4494 , piece_id=7PP3T6WZX2WMUKMT6OKMWIBJKYRNZV5JUS3IM52S3EOMKVKNO5LA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58186->64.49.13.137:4494: use of closed network connection
Aug 11 02:01:13.591727612 (56h35m35.550824853s) [noise=true , address=79.127.201.215:4345 , piece_id=WMUJXXFL6WECEIPBN7XZ3N4OOXZFN67CCCGOBPX7XETLC3OHHTXA, seg_pos={0 0}, upload=58974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34706->79.127.201.215:4345: use of closed network connection
Aug 11 02:01:13.591746998 (56h35m35.550844243s) [seg_pos={0 0}, upload=58974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 02:01:13.591839833 (56h35m35.550937078s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 02:01:13.591844821 (56h35m35.55094206s) [upload=58974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 02:01:13.731748666 (56h35m35.690845912s) [upload=58974]: Done uploading segments...
Aug 11 02:01:13.731768725 (56h35m35.69086597s) [upload=58974]: Upload finished. err: <nil>
Duration: 2.539388297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|