Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...X....................X............................] duration: 2.676565544s FAIL (2025-07-09 22:26:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.67659022s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..X...........XX.........................X..................] duration: 46.698587122s FAIL (2025-07-09 22:26:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 46.698611457s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...X....................X...........................] duration: 2.516142301s FAIL (2025-07-09 22:26:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.516162788s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...X....................X..........................] duration: 2.679243003s FAIL (2025-07-09 22:25:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.679266075s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...X...........XX.........................X.................] duration: 11.376600679s FAIL (2025-07-09 22:24:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.37663654s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X...X....................X.........................] duration: 2.66747754s FAIL (2025-07-09 22:24:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.667499918s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....X...........XX.........................X................] duration: 27.000574334s FAIL (2025-07-09 22:24:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 27.000613976s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 58.206875018s FAIL (2025-07-09 22:23:14 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 58.206910106s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....X...........XX.........................X...............] duration: 26.696195567s FAIL (2025-07-09 22:23:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 26.69621953s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X...X....................X........................] duration: 2.535910501s FAIL (2025-07-09 22:23:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.535934915s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......X...........XX.........................X..............] duration: 28.980464391s FAIL (2025-07-09 22:22:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.980489581s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X...X....................X.......................] duration: 2.627740153s FAIL (2025-07-09 22:22:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.627830755s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 12.58654027s FAIL (2025-07-09 22:21:22 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 12.58657058s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X...X....................X......................] duration: 2.808321999s FAIL (2025-07-09 22:21:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.808345002s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 45.877034568s FAIL (2025-07-09 22:21:07 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 45.877069086s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......X...........XX.........................X.............] duration: 19.447720503s FAIL (2025-07-09 22:20:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 19.447741781s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........X...........XX.........................X............] duration: 18.118210916s FAIL (2025-07-09 22:20:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.118228991s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X...X....................X.....................] duration: 2.628002887s FAIL (2025-07-09 22:20:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.62810241s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 18.723369693s FAIL (2025-07-09 22:20:06 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 18.723396436s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.........X...........XX.........................X...........] duration: 37.842699714s FAIL (2025-07-09 22:19:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 37.842720842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 42.52490183s FAIL (2025-07-09 22:19:47 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 42.524928341s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X...X....................X....................] duration: 2.61758057s FAIL (2025-07-09 22:19:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.617681124s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........X...........XX.........................X..........] duration: 22.408074057s FAIL (2025-07-09 22:18:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.40815018s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X...X....................X...................] duration: 2.825953882s FAIL (2025-07-09 22:18:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.826068182s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 10.657395461s FAIL (2025-07-09 22:18:29 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 10.657424586s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........X...........XX.........................X.........] duration: 11.781569321s FAIL (2025-07-09 22:18:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.781615616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 21.225651614s FAIL (2025-07-09 22:18:07 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 21.225680327s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............X...........XX.........................X........] duration: 18.529311657s FAIL (2025-07-09 22:18:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.529331752s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X...X....................X..................] duration: 2.812649891s FAIL (2025-07-09 22:17:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.812689886s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 13.81616393s FAIL (2025-07-09 22:17:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 13.816195793s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............X...........XX.........................X.......] duration: 19.341152541s FAIL (2025-07-09 22:17:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 19.341195008s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X.......X...................................................] duration: 10.842692442s FAIL (2025-07-09 22:16:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 10.842722675s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X...X....................X.................] duration: 2.636083756s FAIL (2025-07-09 22:16:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.636112349s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X.......X..................................................] duration: 10.457016282s FAIL (2025-07-09 22:16:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 10.457046899s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X...X....................X................] duration: 2.834146494s FAIL (2025-07-09 22:16:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.834176296s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............X...........XX.........................X......] duration: 35.963664642s FAIL (2025-07-09 22:16:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 35.963707468s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X...X....................X...............] duration: 2.647874599s FAIL (2025-07-09 22:15:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.648184827s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X.......X.................................................] duration: 24.563586381s FAIL (2025-07-09 22:15:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 24.563618071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X...X....................X..............] duration: 2.719119307s FAIL (2025-07-09 22:15:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.719140857s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X.......X................................................] duration: 10.542914631s FAIL (2025-07-09 22:15:02 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 10.542973969s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............X...........XX.........................X.....] duration: 15.214969734s FAIL (2025-07-09 22:14:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.214982695s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................X...........XX.........................X....] duration: 36.958151985s FAIL (2025-07-09 22:14:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 36.958176556s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X.......X...............................................] duration: 28.221933s FAIL (2025-07-09 22:14:34 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 28.221972354s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...X....................X.............] duration: 2.816831827s FAIL (2025-07-09 22:14:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.816858006s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X.......X..............................................] duration: 13.257953924s FAIL (2025-07-09 22:13:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 13.257978312s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X...X....................X............] duration: 2.656982892s FAIL (2025-07-09 22:13:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.657023299s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................X...........XX.........................X...] duration: 16.377139456s FAIL (2025-07-09 22:13:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.377771525s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [X.....X.......X.............................................] duration: 8.261590017s FAIL (2025-07-09 22:13:38 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 8.261618259s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X...X....................X...........] duration: 2.843537536s FAIL (2025-07-09 22:13:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.843564964s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.X.....X.......X............................................] duration: 22.737378503s FAIL (2025-07-09 22:13:06 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 22.737419228s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)