Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.348087115s
FAIL (2025-09-22 15:17:53 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.348164589s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.232887082s
FAIL (2025-09-22 15:17:30 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.232920769s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..................................X.................] duration:
2.515266568s
FAIL (2025-09-22 15:17:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.515297009s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.595711242s
FAIL (2025-09-22 15:17:00 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.595751415s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..................................X................] duration:
2.476815026s
FAIL (2025-09-22 15:16:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.476846637s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.041548909s
FAIL (2025-09-22 15:16:41 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.041587113s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.392957808s
FAIL (2025-09-22 15:16:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.392990544s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.117557587s
FAIL (2025-09-22 15:16:07 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.11759091s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..................................X...............] duration:
2.398411159s
FAIL (2025-09-22 15:15:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.398439462s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.27817516s
FAIL (2025-09-22 15:15:48 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.278205733s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.480209888s
FAIL (2025-09-22 15:15:01 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.480241658s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.094862913s
FAIL (2025-09-22 15:14:55 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.094890466s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..................................X..............] duration:
2.501174694s
FAIL (2025-09-22 15:14:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.501207308s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..................................X.............] duration:
2.459238767s
FAIL (2025-09-22 15:14:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.459274939s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.190246314s
FAIL (2025-09-22 15:14:11 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.190279114s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.118207621s
FAIL (2025-09-22 15:13:52 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.118249219s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.375066287s
FAIL (2025-09-22 15:13:30 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.375353421s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..................................X............] duration:
2.668520672s
FAIL (2025-09-22 15:13:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.66855473s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.624620186s
FAIL (2025-09-22 15:13:03 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.624658613s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.478186992s
FAIL (2025-09-22 15:12:59 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.478231741s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.546147621s
FAIL (2025-09-22 15:12:13 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.546204007s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................................X...........] duration:
2.74451231s
FAIL (2025-09-22 15:12:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.744543295s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.11732668s
FAIL (2025-09-22 15:12:04 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.117365153s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..................................X..........] duration:
2.409309726s
FAIL (2025-09-22 15:11:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.409339334s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
982.289046ms
FAIL (2025-09-22 15:11:20 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 982.326141ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.50882585s
FAIL (2025-09-22 15:11:01 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.508863311s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.022433926s
FAIL (2025-09-22 15:10:27 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.022472768s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..................................X.........] duration:
2.637455175s
FAIL (2025-09-22 15:10:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.637490346s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..................................X........] duration:
2.406842524s
FAIL (2025-09-22 15:10:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.406954362s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.366788672s
FAIL (2025-09-22 15:10:08 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.366936187s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..................................X.......] duration:
2.836723436s
FAIL (2025-09-22 15:09:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.836751538s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.333722974s
FAIL (2025-09-22 15:09:30 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.333753947s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
974.163953ms
FAIL (2025-09-22 15:09:25 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 974.200033ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.044423695s
FAIL (2025-09-22 15:08:46 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.044454061s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.156592401s
FAIL (2025-09-22 15:08:41 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.156628213s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..................................X......] duration:
2.510912384s
FAIL (2025-09-22 15:08:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.510963224s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
951.886417ms
FAIL (2025-09-22 15:08:08 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 951.932052ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..................................X.....] duration:
2.940423543s
FAIL (2025-09-22 15:07:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.94046218s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.265151483s
FAIL (2025-09-22 15:07:36 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.265286876s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..................................X....] duration:
2.421971466s
FAIL (2025-09-22 15:07:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.422004305s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.178529617s
FAIL (2025-09-22 15:07:10 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.178548999s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.538441371s
FAIL (2025-09-22 15:07:10 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.538469736s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.554938458s
FAIL (2025-09-22 15:06:52 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.554978154s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..................................X...] duration:
2.391414282s
FAIL (2025-09-22 15:06:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.391447381s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..................................X..] duration:
2.743733675s
FAIL (2025-09-22 15:06:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.743765218s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.186460192s
FAIL (2025-09-22 15:06:03 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.186509661s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.610757288s
FAIL (2025-09-22 15:05:42 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.610791225s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..................................X.] duration:
2.420913745s
FAIL (2025-09-22 15:05:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.420946307s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.060475663s
FAIL (2025-09-22 15:05:08 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.060511655s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..................................X] duration:
30.00212358s
FAIL (2025-09-22 15:04:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 30.002147092s
core
uplink
us-select-1
|