Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
462.056061ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 13:04:56 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" ""
Duration: 462.087707ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.371986636s
FAIL (2025-07-14 13:04:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.372035885s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
567.706424ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 13:04:31 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" ""
Duration: 567.733131ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
477.600459ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 13:03:59 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" ""
Duration: 477.625085ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.303909451s
FAIL (2025-07-14 13:03:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.30393738s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.398043945s
FAIL (2025-07-14 13:03:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.398072994s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
329.811705ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 13:02:51 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" ""
Duration: 329.825265ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.303894639s
FAIL (2025-07-14 13:02:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.303931086s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.470937085s
FAIL (2025-07-14 13:01:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.470972922s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.35860133s
FAIL (2025-07-14 13:00:30 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.358642486s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.326178781s
FAIL (2025-07-14 12:59:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.326211224s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.41681714s
FAIL (2025-07-14 12:59:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.416849239s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.346226793s
FAIL (2025-07-14 12:57:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.34625922s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.35190626s
FAIL (2025-07-14 12:56:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.35195778s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.322621504s
FAIL (2025-07-14 12:56:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.322660719s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.373333675s
FAIL (2025-07-14 12:55:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.373368013s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.348825401s
FAIL (2025-07-14 12:55:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.348860479s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.340304217s
FAIL (2025-07-14 12:54:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.340338872s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.354976516s
FAIL (2025-07-14 12:53:36 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.355010219s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.458396995s
FAIL (2025-07-14 12:52:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.458434654s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.650285795s
FAIL (2025-07-14 12:52:14 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.650323532s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.334134453s
FAIL (2025-07-14 12:51:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.334167858s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.37100786s
FAIL (2025-07-14 12:51:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.371046549s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.41842096s
FAIL (2025-07-14 12:50:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.418468821s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.353684042s
FAIL (2025-07-14 12:50:17 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.353713125s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.337840092s
FAIL (2025-07-14 12:49:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.33789112s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.464285596s
FAIL (2025-07-14 12:48:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.464320271s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.320457932s
FAIL (2025-07-14 12:47:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.320488101s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.3538121s
FAIL (2025-07-14 12:46:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.353959547s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.302193286s
FAIL (2025-07-14 12:46:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.302233438s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.407166723s
FAIL (2025-07-14 12:45:34 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 2.407190491s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001257347s
FAIL (2025-07-14 12:45:31 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil>
Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments...
Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil>
Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload
Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload
Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments...
Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false
Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment...
Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment.
Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece...
Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment
Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments...
Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces.
Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF
Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil>
Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments...
Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil>
Duration: 30.001340049s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.073862676s
FAIL (2025-07-14 05:32:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.073887675s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.638805201s
FAIL (2025-07-14 05:31:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.638833896s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.156263171s
FAIL (2025-07-14 05:31:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.156319148s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.673571902s
FAIL (2025-07-14 05:31:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.673598174s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.101197457s
FAIL (2025-07-14 05:31:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.101228943s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.778860807s
FAIL (2025-07-14 05:30:54 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.778889197s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.056529555s
FAIL (2025-07-14 05:30:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.056562473s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.77431352s
FAIL (2025-07-14 05:30:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.774339574s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.051319519s
FAIL (2025-07-14 05:30:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.051348557s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.111307301s
FAIL (2025-07-14 05:29:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.111342233s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.52715018s
FAIL (2025-07-14 05:29:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.527203621s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.054203686s
FAIL (2025-07-14 05:29:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.055105483s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.524907301s
FAIL (2025-07-14 05:28:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.524932954s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.214414269s
FAIL (2025-07-14 05:28:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.214472439s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.554403311s
FAIL (2025-07-14 05:28:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.55442802s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.871314913s
FAIL (2025-07-14 05:27:54 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.871336953s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.108917442s
FAIL (2025-07-14 05:27:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.108939159s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.136080377s
FAIL (2025-07-14 05:27:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.136106466s
edge
gateway
us-select-1
|