Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..................X...........XX.........................X..] duration: 37.261468724s FAIL (2025-07-09 22:13:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 37.261554354s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X...X....................X..........] duration: 2.628982553s FAIL (2025-07-09 22:12:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.629007145s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................X...........XX.........................X.] duration: 33.132697407s FAIL (2025-07-09 22:12:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 33.132726146s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [X.X.....X.......X...........................................] duration: 31.183526429s FAIL (2025-07-09 22:12:12 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 31.183559889s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...X....................X.........] duration: 2.648034527s FAIL (2025-07-09 22:12:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.648060273s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................X...........XX.........................X] duration: 1m0.001378858s FAIL (2025-07-09 22:11:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001417488s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.X.X.....X.......X..........................................] duration: 24.724204194s FAIL (2025-07-09 22:11:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 24.724232337s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X...X....................X........] duration: 2.679361685s FAIL (2025-07-09 22:11:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.679395431s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..X.X.....X.......X.........................................] duration: 11.445207098s FAIL (2025-07-09 22:10:57 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 11.445230635s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...X.X.....X.......X........................................] duration: 42.965404839s FAIL (2025-07-09 22:10:46 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 42.965440882s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...........XX.........................] duration: 33.109695537s FAIL (2025-07-09 22:10:37 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 33.109724929s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X...X....................X.......] duration: 2.804477351s FAIL (2025-07-09 22:10:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.804504039s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....X.X.....X.......X.......................................] duration: 22.289123278s FAIL (2025-07-09 22:10:02 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 22.28918277s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X...X....................X......] duration: 2.776713205s FAIL (2025-07-09 22:09:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.776750725s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................X...........XX........................] duration: 26.715736489s FAIL (2025-07-09 22:09:41 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 26.715750461s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....X.X.....X.......X......................................] duration: 40.063414075s FAIL (2025-07-09 22:09:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 40.063442206s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X...X....................X.....] duration: 2.625519198s FAIL (2025-07-09 22:09:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.625553481s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................X...........XX.......................] duration: 16.422216463s FAIL (2025-07-09 22:08:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.422239355s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X...X....................X....] duration: 2.584853812s FAIL (2025-07-09 22:08:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.584884847s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......X.X.....X.......X.....................................] duration: 34.069135975s FAIL (2025-07-09 22:08:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 34.069165548s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................X...........XX......................] duration: 20.700990071s FAIL (2025-07-09 22:07:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.701011527s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X...X....................X...] duration: 2.50546836s FAIL (2025-07-09 22:07:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.50549266s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......X.X.....X.......X....................................] duration: 10.368092103s FAIL (2025-07-09 22:07:04 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 10.368124868s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...........XX.....................] duration: 38.540291441s FAIL (2025-07-09 22:07:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 38.540316609s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X...X....................X..] duration: 2.797914283s FAIL (2025-07-09 22:06:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.797928571s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........X.X.....X.......X...................................] duration: 34.152190797s FAIL (2025-07-09 22:06:28 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 34.152222228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................X...........XX....................] duration: 24.684518049s FAIL (2025-07-09 22:06:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 24.684533887s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........................X...........XX...................] duration: 40.126091193s FAIL (2025-07-09 22:05:57 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 40.126116728s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.........X.X.....X.......X..................................] duration: 20.305987366s FAIL (2025-07-09 22:05:54 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 20.306020737s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X...X....................X.] duration: 2.787283724s FAIL (2025-07-09 22:05:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.787310337s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........X.X.....X.......X.................................] duration: 24.757054003s FAIL (2025-07-09 22:05:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 24.757087913s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X...X....................X] duration: 30.001344707s FAIL (2025-07-09 22:05:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.002010185s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............................X...........XX..................] duration: 31.862458274s FAIL (2025-07-09 22:04:51 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.862479885s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........X.X.....X.......X................................] duration: 22.176869429s FAIL (2025-07-09 22:04:38 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 22.176898071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..................................X...X....................] duration: 21.998054124s FAIL (2025-07-09 22:04:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.998089467s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............................X...........XX.................] duration: 18.637215154s FAIL (2025-07-09 22:04:19 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.637227559s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............................X...........XX................] duration: 36.617942854s FAIL (2025-07-09 22:04:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 36.617968057s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..................................X...X...................] duration: 2.741645368s FAIL (2025-07-09 22:03:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.741682234s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............X.X.....X.......X...............................] duration: 23.444086302s FAIL (2025-07-09 22:03:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 23.444110998s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............................X...........XX...............] duration: 27.507831949s FAIL (2025-07-09 22:03:07 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 27.507858404s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............X.X.....X.......X..............................] duration: 36.091588655s FAIL (2025-07-09 22:03:04 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 36.091627825s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [................................X...........XX..............] duration: 21.748936688s FAIL (2025-07-09 22:02:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.748948388s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..................................X...X..................] duration: 2.730630054s FAIL (2025-07-09 22:02:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.730654774s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.................................X...........XX.............] duration: 36.199526487s FAIL (2025-07-09 22:02:08 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 36.199541125s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............X.X.....X.......X.............................] duration: 26.010035367s FAIL (2025-07-09 22:01:53 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 26.010079478s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X..................................X...X.................] duration: 2.542653218s FAIL (2025-07-09 22:01:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.542701728s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................................X...........XX............] duration: 35.330169005s FAIL (2025-07-09 22:01:31 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 35.330193129s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............X.X.....X.......X............................] duration: 19.571670679s FAIL (2025-07-09 22:01:15 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 19.571698228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...................................X...........XX...........] duration: 29.183808248s FAIL (2025-07-09 22:00:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 29.183828694s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X..................................X...X................] duration: 2.691931409s FAIL (2025-07-09 22:00:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.691988192s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)