Orbiter History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 467.792497ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:24:19 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 467.89276ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.670449031s FAIL (2025-07-14 13:24:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.670482941s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.318854321s FAIL (2025-07-14 13:23:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.31896181s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 458.659344ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:23:11 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 458.706045ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.385789663s FAIL (2025-07-14 13:22:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.385822625s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.343951071s FAIL (2025-07-14 13:22:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.343983879s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 609.470342ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:22:01 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 609.51076ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.301458464s FAIL (2025-07-14 13:21:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.301489124s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 474.376441ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:21:41 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 474.417593ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 471.462116ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:21:25 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 471.491443ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.361685861s FAIL (2025-07-14 13:20:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.361722149s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 464.002369ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:20:42 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 464.031467ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.444533763s FAIL (2025-07-14 13:20:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.444581275s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.373404828s FAIL (2025-07-14 13:20:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.373438937s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.358952698s FAIL (2025-07-14 13:19:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.35898413s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 552.90987ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:19:43 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 552.932832ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.507364976s FAIL (2025-07-14 13:19:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.507419121s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 562.501708ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:19:06 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 562.531154ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 452.538039ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:18:40 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 452.566496ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 592.117252ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:18:16 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 592.158745ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.334557251s FAIL (2025-07-14 13:18:01 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.334593082s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.333774435s FAIL (2025-07-14 13:17:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.333803961s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 459.701131ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:17:20 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 459.726954ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.294081407s FAIL (2025-07-14 13:16:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.294119502s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 758.666549ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:16:24 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 758.702839ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.331764558s FAIL (2025-07-14 13:15:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.33186398s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 455.025936ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:15:11 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 455.051497ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 474.004772ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:14:55 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 474.033334ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.366434868s FAIL (2025-07-14 13:14:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.366466946s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 477.796758ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:14:21 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 477.823796ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.349702964s FAIL (2025-07-14 13:13:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.349751722s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 463.336674ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:13:26 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 463.370389ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 486.25084ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:12:58 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 486.282542ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.353416242s FAIL (2025-07-14 13:12:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.353444301s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 452.406923ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:12:17 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 452.447749ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.367083734s FAIL (2025-07-14 13:11:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.367116032s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 470.641311ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:11:19 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 470.668647ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.354895134s FAIL (2025-07-14 13:10:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.354928318s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 451.974206ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:10:09 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 452.002527ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.335465207s FAIL (2025-07-14 13:09:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.335502053s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 461.658836ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:08:56 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 461.704848ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.368422956s FAIL (2025-07-14 13:08:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.368458045s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 465.048626ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:08:04 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 465.085133ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.571327272s FAIL (2025-07-14 13:07:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.571360793s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 458.275891ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:07:31 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 458.304182ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.332502607s FAIL (2025-07-14 13:07:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.332534179s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.343185262s FAIL (2025-07-14 13:06:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.343213026s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 476.813981ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:06:19 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 476.842744ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 538.745424ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Mon, 14 Jul 2025 13:02:51 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-14 13:05:59 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 538.778466ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.394500654s FAIL (2025-07-14 13:05:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== true , address=45.91.116.6:4974 , piece_id=NDKVI7SH6A7VVNDZ4AUCN4EMW7N3UCTWRV4YWN7X7GUWUOC4RYAQ, seg_pos={0 0}, upload=405945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:07.449040318 (507h33m7.332453936s) [noise=true , address=45.91.116.11:4119 , piece_id=OLA3GRYXL65EFAKTMEVS5BLO3RTLB2FEFRWF3HWHT7NDLVQGIEUA, seg_pos={0 0}, upload=405945]: Done uploading piece. err: <nil> Jul 14 12:44:07.449081351 (507h33m7.33249497s) [seg_pos={0 0}, upload=405945]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:07.449218376 (507h33m7.332632002s) [upload=405945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:07.449224645 (507h33m7.332638272s) [upload=405945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:07.590968901 (507h33m7.47438253s) [upload=405945]: Done uploading segments... Jul 14 12:44:07.590988109 (507h33m7.474401728s) [upload=405945]: Upload finished. err: <nil> Jul 14 12:44:30.351448695 (507h33m30.234862308s) [upload=405950]: Starting upload Jul 14 12:44:30.351516267 (507h33m30.2349299s) [upload=405950]: Done starting upload Jul 14 12:44:30.351775528 (507h33m30.235189141s) [upload=405950]: Uploading segments... Jul 14 12:44:30.351816917 (507h33m30.23523055s) [upload=405950]: Got next segment. Inline: false Jul 14 12:44:30.351846774 (507h33m30.235260386s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 12:44:30.351851275 (507h33m30.235264886s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 12:44:30.470535521 (507h33m30.353949137s) [seg_pos={0 0}, upload=405950]: Begin upload segment... Jul 14 12:44:30.470600462 (507h33m30.354014091s) [seg_pos={0 0}, upload=405950]: Done begin upload segment. Jul 14 12:44:30.470627068 (507h33m30.354040697s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.470715887 (507h33m30.354129532s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471119813 (507h33m30.354533441s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471136415 (507h33m30.354550044s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471417316 (507h33m30.354830942s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471452938 (507h33m30.354866563s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471666091 (507h33m30.355079716s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471725777 (507h33m30.355139406s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471975061 (507h33m30.355388698s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.471994150 (507h33m30.355407779s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472040477 (507h33m30.355454106s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472330086 (507h33m30.355743711s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472386472 (507h33m30.355800104s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472642434 (507h33m30.356056062s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.472773912 (507h33m30.35618755s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:30.473019886 (507h33m30.356433513s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Uploading piece... Jul 14 12:44:31.081604036 (507h33m30.965017656s) [upload=405950]: Next returned nil segment Jul 14 12:44:31.081619117 (507h33m30.965032747s) [upload=405950]: Waiting for error group managing segments... Jul 14 12:44:31.212370528 (507h33m31.095784152s) [noise=true , address=77.90.31.21:4877 , piece_id=23QGJZNQSJ7KOXSZ3ULSZZ5ENPT57GEC5TPKIP2U4O37JABH2X6A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215198738 (507h33m31.098612358s) [noise=true , address=77.90.31.13:4628 , piece_id=BC2R5YGKW4IGDTL3WPD4MFSB4U2VHI4FWLI5IP3T444FZ43JHY2Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.215277090 (507h33m31.09869071s) [noise=true , address=45.91.116.13:4155 , piece_id=AR3J7HWP2NL435A3WPEL3HTJQ5VU37PEN3YS5Y3VS3RQZZE6RQWA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.216179947 (507h33m31.099593568s) [noise=true , address=45.91.116.6:4975 , piece_id=I3F657IU3CRK67NDICZJPZECBCYJT5BDFSTIYJRSN4AZKH7236DA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.217429889 (507h33m31.100843512s) [noise=true , address=45.91.116.4:4939 , piece_id=TCKCPX72MPHWWYQMH6Y5QHDUK4KWD73BPOT5VPJ37AG3X6C4PSPQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.220422975 (507h33m31.10383659s) [noise=true , address=77.90.31.15:4699 , piece_id=T7WDHJ4ZSEVDGB76YKOFA3CZ4OJLJDSAYYJ64UJC3BVNKGMEGP2A, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231242140 (507h33m31.114655753s) [noise=true , address=45.91.116.6:4974 , piece_id=U2K7SWOTBGKONRYZO2T6ULFGJQ2RXUEDHMFA2NBXI6CJLHJC32PQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.231730934 (507h33m31.115144558s) [noise=true , address=77.90.31.12:4592 , piece_id=7XNTXOIPWEN2C2GLOYKFY56JDLYHU3Y4FSKB5ZSXSOGYD2VZZGBQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.235621076 (507h33m31.119034694s) [noise=true , address=45.91.116.11:4118 , piece_id=JBCOIFJ3RAG4FFEDLDH3JFN2IDMBWUKSNZLMPJYB77TGPVDT3V3Q, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.241091189 (507h33m31.124504808s) [noise=true , address=45.91.116.5:4297 , piece_id=BEL6S735QQW7J3DBNP66WVHSAET3D7NVC3GG257TVLRJQ43XVRYQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.262409993 (507h33m31.145823631s) [noise=true , address=104.36.82.13:4187 , piece_id=XINJM334MJZP4QX7O3EOGCGRYOVYK3HCOPMNVD7RL46PG5X4Z4TA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266401900 (507h33m31.149815517s) [noise=true , address=104.36.82.10:4078 , piece_id=TZYHHI4DHSUB7CYURTAYMRSZVIZAM3VVRZHZHZJ7ZCOXPK4GMWLA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266666464 (507h33m31.150080087s) [noise=true , address=77.90.31.19:4841 , piece_id=ZLEJS5FW2QVWESANU5BBEPIQJJQVYR7KZYVKWB3MZLX4ZND6GZZA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.266677151 (507h33m31.150090764s) [seg_pos={0 0}, upload=405950]: Segment reached optimal threshold of 13 pieces. Jul 14 12:44:31.266850828 (507h33m31.150264447s) [noise=true , address=104.36.82.11:4114 , piece_id=TIPP675F55IYKYFPRE3FFBAQWT4LXOYN72K4MZ3HIF2N6IX3PAFQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267033616 (507h33m31.150447233s) [noise=true , address=104.36.82.3:4767 , piece_id=YXY3IEX2VOX4LUFHHX72YQ6XVVWKDMJOQ5RBM4TFN24ZC26FCEIA, seg_pos={0 0}, upload=405950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 14 12:44:31.267254778 (507h33m31.150668391s) [noise=true , address=104.36.82.2:4730 , piece_id=3TOULQ3R5QJHCJAIYZXDXDYMNRL3DOSNNRQMAYHNVZOHYSTVFBTQ, seg_pos={0 0}, upload=405950]: Done uploading piece. err: <nil> Jul 14 12:44:31.267299295 (507h33m31.150712922s) [seg_pos={0 0}, upload=405950]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 14 12:44:31.267384625 (507h33m31.150798255s) [upload=405950]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 12:44:31.267390804 (507h33m31.150804433s) [upload=405950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 12:44:31.418211429 (507h33m31.301625049s) [upload=405950]: Done uploading segments... Jul 14 12:44:31.418243710 (507h33m31.301657337s) [upload=405950]: Upload finished. err: <nil> Duration: 2.394546416s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)