Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................X.X.....X.......X...........................] duration: 44.686052708s FAIL (2025-07-09 22:00:28 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 44.686099237s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....................................X...........XX..........] duration: 26.85087929s FAIL (2025-07-09 22:00:26 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 26.850908996s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X...........XX.........] duration: 44.122699609s FAIL (2025-07-09 21:59:54 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 44.12271562s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X..................................X...X...............] duration: 20.153707493s FAIL (2025-07-09 21:59:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.154238506s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................X.X.....X.......X..........................] duration: 34.399149275s FAIL (2025-07-09 21:59:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 34.399184459s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X..................................X...X..............] duration: 2.624322066s FAIL (2025-07-09 21:58:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.624348777s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................................X...........XX........] duration: 28.717573262s FAIL (2025-07-09 21:58:45 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.717592192s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X..................................X...X.............] duration: 2.63051613s FAIL (2025-07-09 21:58:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.630620965s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..................X.X.....X.......X.........................] duration: 22.703867368s FAIL (2025-07-09 21:58:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 22.703904592s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................X.X.....X.......X........................] duration: 15.278890891s FAIL (2025-07-09 21:57:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 15.278913084s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X...........XX.......] duration: 35.594208977s FAIL (2025-07-09 21:57:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 35.594227357s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X..................................X...X............] duration: 2.563299412s FAIL (2025-07-09 21:57:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.563373503s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................X.X.....X.......X.......................] duration: 28.345193332s FAIL (2025-07-09 21:57:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 28.345215154s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................................X...........XX......] duration: 35.653610632s FAIL (2025-07-09 21:57:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 35.653642506s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.X.....X.......X......................] duration: 38.479220321s FAIL (2025-07-09 21:56:57 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 38.479249811s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X..................................X...X...........] duration: 2.796778683s FAIL (2025-07-09 21:56:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.796820167s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X..................................X...X..........] duration: 2.817239487s FAIL (2025-07-09 21:56:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.817270372s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X...........XX.....] duration: 22.798797679s FAIL (2025-07-09 21:56:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.798822167s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......................X.X.....X.......X.....................] duration: 14.00576895s FAIL (2025-07-09 21:55:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 14.005791076s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X..................................X...X.........] duration: 10.700820549s FAIL (2025-07-09 21:55:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.700865847s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X...........XX....] duration: 36.405138061s FAIL (2025-07-09 21:55:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 36.405166846s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X..................................X...X........] duration: 2.942750188s FAIL (2025-07-09 21:55:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.942793685s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.X.....X.......X....................] duration: 29.024050098s FAIL (2025-07-09 21:55:00 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 29.024081179s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................X.X.....X.......X...................] duration: 14.543001597s FAIL (2025-07-09 21:54:11 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 14.543030621s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X..................................X...X.......] duration: 2.875562994s FAIL (2025-07-09 21:54:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.875586041s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X...........XX...] duration: 36.838793886s FAIL (2025-07-09 21:54:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 36.838840796s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.X.....X.......X..................] duration: 33.274840889s FAIL (2025-07-09 21:53:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 33.274874678s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X..................................X...X......] duration: 2.877680135s FAIL (2025-07-09 21:53:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.877746326s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............................................X...........XX..] duration: 30.418259404s FAIL (2025-07-09 21:53:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.418282668s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.X.....X.......X.................] duration: 15.120369201s FAIL (2025-07-09 21:52:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 15.12042744s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X..................................X...X.....] duration: 2.746267895s FAIL (2025-07-09 21:52:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.746290606s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X...........XX.] duration: 29.374260562s FAIL (2025-07-09 21:51:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 29.37427644s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X..................................X...X....] duration: 2.49896385s FAIL (2025-07-09 21:51:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.4989905s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.X.....X.......X................] duration: 28.75305388s FAIL (2025-07-09 21:51:40 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 28.753081883s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X...........XX] duration: 1m0.001010573s FAIL (2025-07-09 21:51:25 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001031313s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............................X.X.....X.......X...............] duration: 33.409217708s FAIL (2025-07-09 21:50:51 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 33.409239895s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X..................................X...X...] duration: 2.79545167s FAIL (2025-07-09 21:50:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.79547787s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X...........X] duration: 1m0.001557831s FAIL (2025-07-09 21:50:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001601389s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............................X.X.....X.......X..............] duration: 43.147373777s FAIL (2025-07-09 21:50:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 43.147403062s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X..................................X...X..] duration: 2.731542718s FAIL (2025-07-09 21:50:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.731569099s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............................X.X.....X.......X.............] duration: 14.338508244s FAIL (2025-07-09 21:49:25 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 14.338541903s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X..................................X...X.] duration: 2.803881622s FAIL (2025-07-09 21:49:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.803981055s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 25.014996719s FAIL (2025-07-09 21:49:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 25.015024385s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............................X.X.....X.......X............] duration: 31.560367253s FAIL (2025-07-09 21:48:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 31.560397997s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X..................................X...X] duration: 30.000600047s FAIL (2025-07-09 21:48:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00062174s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 30.72967694s FAIL (2025-07-09 21:48:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.729697348s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................................X.X.....X.......X...........] duration: 23.709882395s FAIL (2025-07-09 21:47:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 23.709908584s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..................................X...] duration: 2.551980885s FAIL (2025-07-09 21:47:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.552018119s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 31.215140631s FAIL (2025-07-09 21:47:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.215173598s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................................X.X.....X.......X..........] duration: 8.983374333s FAIL (2025-07-09 21:46:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ad=317059]: Got next segment. Inline: false Jul 9 21:39:37.379940998 (396h28m37.263354631s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 21:39:37.379950180 (396h28m37.263363814s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 21:39:37.581511580 (396h28m37.464925193s) [seg_pos={0 0}, upload=317059]: Begin upload segment... Jul 9 21:39:37.581575434 (396h28m37.464989047s) [seg_pos={0 0}, upload=317059]: Done begin upload segment. Jul 9 21:39:37.581608674 (396h28m37.465022313s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.581625259 (396h28m37.465038894s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582205955 (396h28m37.465619593s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582226329 (396h28m37.465639963s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582706977 (396h28m37.466120591s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.582754275 (396h28m37.46616791s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583166819 (396h28m37.466580453s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583619396 (396h28m37.467033031s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.583774378 (396h28m37.467188015s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584023120 (396h28m37.467436756s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584314386 (396h28m37.467727999s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.584647353 (396h28m37.468060989s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585042256 (396h28m37.468455885s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585393807 (396h28m37.468807437s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.585718047 (396h28m37.469131684s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586211315 (396h28m37.469624953s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586583666 (396h28m37.469997301s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:37.586947894 (396h28m37.470361527s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Uploading piece... Jul 9 21:39:38.176690504 (396h28m38.060104117s) [upload=317059]: Next returned nil segment Jul 9 21:39:38.176710781 (396h28m38.060124394s) [upload=317059]: Waiting for error group managing segments... Jul 9 21:39:38.299966905 (396h28m38.183380542s) [noise=true , address=77.90.31.17:4773 , piece_id=ZTMXELKUKJ7HAKFHUYD7ON6Z26H7M26TTZJMIVMMFWBWYC7QHHXA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.301708854 (396h28m38.185122474s) [noise=true , address=77.90.31.14:4673 , piece_id=LFWT3VUTU4JAWSLG37JVDPFJ6MHQHUNU7HIMKUS6RHAHMUJLDYPQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.310678123 (396h28m38.194091753s) [noise=true , address=77.90.31.12:4594 , piece_id=XDBGCD5MCJCR7UFBFAZSNDX235ZURWA4PFHDUAF7CJTNPE2J7PLQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.313776483 (396h28m38.197190133s) [noise=true , address=77.90.31.13:4634 , piece_id=KMNACWQZCINWWI2P3VNLKA565AYC7WP457ANBJ3AOH4NOGGAP27Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.323851883 (396h28m38.207265494s) [noise=true , address=77.90.31.21:4909 , piece_id=Z7OGPXQ345RV2XXPRRYEI3MDSNO42LHKNMVBSCBO47DBG2CFAUBQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:38.508194899 (396h28m38.391608539s) [noise=true , address=79.127.220.101:4042 , piece_id=MTJ6QPBBQKMHSMRS5AWEI3CCV26MDV2Q7HYMEJFHIXZUIZPW6MLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:39.206881385 (396h28m39.090295021s) [noise=true , address=79.127.205.246:4254 , piece_id=4TGZP55MUE2EYSI4YQ5SDAIPSTKQKEVZ4FGK32AHOHAHEGXN6AAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:49.770414492 (396h28m49.653828104s) [noise=true , address=104.36.82.13:4198 , piece_id=LCZWBN6S6YXGSZOL3IEGS2RK7EUOGAXU2YUR6NUN2SS45GUDTMLA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:51.357190557 (396h28m51.24060419s) [noise=true , address=79.127.219.38:4019 , piece_id=TB5IGJRG4GD7NKKYCI5VYRZTCIE26PNZ6NEFCAJF5QSGUZA7XYWA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:39:59.059221610 (396h28m58.942635224s) [noise=true , address=104.36.82.7:4927 , piece_id=ZBPZVD57SR4MWWWRGF2JPVJNS3W4ONHV2KXS2WRGXAWNBXBTEMCQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:14.989732200 (396h29m14.873145814s) [noise=true , address=104.36.82.19:4411 , piece_id=TLLLO6OXFPLNVGGDVMC3OZZ3RBL7FRGRE3NYBWCJNXA5WE4ZD7EQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:19.437261406 (396h29m19.320675023s) [noise=true , address=104.36.82.21:4508 , piece_id=D7F6S6MUJZU5HQXKP7HGTLUVE3SNYGMDNJXDX4LDJOUWIK4NKPEA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:21.442370228 (396h29m21.325783845s) [noise=true , address=104.36.82.5:4867 , piece_id=X4DPTHSB5S5HIVI2MBBKLRHKA2WB3X5QORHN3YT6EEI2E7FP4NJQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515903750 (396h29m34.399317379s) [noise=true , address=104.36.82.34:4569 , piece_id=O57ZEE6IQOHWSIF4M5WW5RJ3QH63TDYQJQL7FCIQDGIF3RQD5V2A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: <nil> Jul 9 21:40:34.515927208 (396h29m34.399340828s) [seg_pos={0 0}, upload=317059]: Segment reached optimal threshold of 14 pieces. Jul 9 21:40:34.516037703 (396h29m34.399451328s) [noise=true , address=45.91.95.5:4006 , piece_id=INII2Z7EJBG42JMMJVNDE2NSPMLGDX2GFSGPXQVM7JNKOU4XFF2Q, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516110939 (396h29m34.399524566s) [noise=true , address=45.91.95.3:4019 , piece_id=7QBSLBTSYUR6SKUSGNPPFU47URSU3RI7YCYKHKGQ3W252ECNN2TQ, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516592515 (396h29m34.400006136s) [noise=true , address=45.91.95.4:4023 , piece_id=FDVLTCUYPHSVI4BPM5CBH5WAZWPMOEVFQR3X2BK6AEXBAX5PUQAA, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c): protocol: expected piece hash; context canceled; EOF Jul 9 21:40:34.516693112 (396h29m34.400106729s) [noise=true , address=45.91.95.2:4033 , piece_id=LCDYTFI3LBSXS47JJAD2ID2OBYJVRKR6OL7G63VP3GUF5E6Y643A, seg_pos={0 0}, upload=317059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bQEzLer6oNTKcy7KCuDqmm8CiJoTCZwSQJqiEeFrADcLGyGxP): protocol: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->45.91.95.2:4033: use of closed network connection Jul 9 21:40:34.516713577 (396h29m34.400127204s) [seg_pos={0 0}, upload=317059]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 21:40:34.516795229 (396h29m34.400208846s) [upload=317059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 21:40:34.516800737 (396h29m34.400214368s) [upload=317059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 21:40:34.680902271 (396h29m34.56431589s) [upload=317059]: Done uploading segments... Jul 9 21:40:34.680921551 (396h29m34.564335167s) [upload=317059]: Upload finished. err: <nil> Duration: 8.983394811s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)