Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.491348092s
FAIL (2025-09-22 15:24:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.49137972s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.603792481s
FAIL (2025-09-22 15:23:51 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.603838917s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.060269223s
FAIL (2025-09-22 15:23:40 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.060313925s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.5644996s
FAIL (2025-09-22 15:23:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.56452946s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.404693161s
FAIL (2025-09-22 15:23:17 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.404731435s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
986.054838ms
FAIL (2025-09-22 15:22:47 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 986.088195ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..................................X........................] duration:
2.555997788s
FAIL (2025-09-22 15:22:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.556033562s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.324242889s
FAIL (2025-09-22 15:22:09 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.324275231s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.180026294s
FAIL (2025-09-22 15:21:48 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.180073892s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..................................X.......................] duration:
2.458882871s
FAIL (2025-09-22 15:21:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.458915021s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..................................X......................] duration:
2.626714742s
FAIL (2025-09-22 15:21:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.626747853s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.506143144s
FAIL (2025-09-22 15:20:58 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.506177577s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.163149272s
FAIL (2025-09-22 15:20:45 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.163200734s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.398143192s
FAIL (2025-09-22 15:20:34 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.398237873s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..................................X.....................] duration:
2.441245308s
FAIL (2025-09-22 15:20:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.441280492s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.064386594s
FAIL (2025-09-22 15:20:05 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.064451604s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.469795166s
FAIL (2025-09-22 15:19:52 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.469832638s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
984.030165ms
FAIL (2025-09-22 15:19:48 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 984.067659ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..................................X....................] duration:
2.733059577s
FAIL (2025-09-22 15:19:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.733472176s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.075425833s
FAIL (2025-09-22 15:19:22 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.075456172s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..................................X...................] duration:
2.805327794s
FAIL (2025-09-22 15:19:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.805367441s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.11289946s
FAIL (2025-09-22 15:18:48 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.112927441s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.42909522s
FAIL (2025-09-22 15:18:38 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.429147818s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.098557431s
FAIL (2025-09-22 15:18:13 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.098590308s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..................................X..................] duration:
2.520126865s
FAIL (2025-09-22 15:17:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.52016088s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.348087115s
FAIL (2025-09-22 15:17:53 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.348164589s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.232887082s
FAIL (2025-09-22 15:17:30 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.232920769s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..................................X.................] duration:
2.515266568s
FAIL (2025-09-22 15:17:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.515297009s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.595711242s
FAIL (2025-09-22 15:17:00 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.595751415s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..................................X................] duration:
2.476815026s
FAIL (2025-09-22 15:16:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.476846637s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.041548909s
FAIL (2025-09-22 15:16:41 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.041587113s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.392957808s
FAIL (2025-09-22 15:16:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.392990544s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.117557587s
FAIL (2025-09-22 15:16:07 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.11759091s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..................................X...............] duration:
2.398411159s
FAIL (2025-09-22 15:15:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.398439462s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.27817516s
FAIL (2025-09-22 15:15:48 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.278205733s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.480209888s
FAIL (2025-09-22 15:15:01 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.480241658s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.094862913s
FAIL (2025-09-22 15:14:55 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.094890466s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..................................X..............] duration:
2.501174694s
FAIL (2025-09-22 15:14:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.501207308s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..................................X.............] duration:
2.459238767s
FAIL (2025-09-22 15:14:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.459274939s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.190246314s
FAIL (2025-09-22 15:14:11 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.190279114s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.118207621s
FAIL (2025-09-22 15:13:52 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.118249219s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.375066287s
FAIL (2025-09-22 15:13:30 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.375353421s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..................................X............] duration:
2.668520672s
FAIL (2025-09-22 15:13:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.66855473s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.624620186s
FAIL (2025-09-22 15:13:03 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.624658613s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.478186992s
FAIL (2025-09-22 15:12:59 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.478231741s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.546147621s
FAIL (2025-09-22 15:12:13 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.546204007s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................................X...........] duration:
2.74451231s
FAIL (2025-09-22 15:12:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.744543295s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.11732668s
FAIL (2025-09-22 15:12:04 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.117365153s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..................................X..........] duration:
2.409309726s
FAIL (2025-09-22 15:11:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload
Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload
Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments...
Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false
Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment...
Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment.
Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece...
Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment
Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments...
Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil>
Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces.
Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments...
Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil>
Duration: 2.409339334s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
982.289046ms
FAIL (2025-09-22 15:11:20 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 982.326141ms
core
uplink
us-select-1
|