Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.725154398s FAIL (2025-07-20 05:40:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.725186775s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 889.336956ms FAIL (2025-07-20 05:40:00 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 889.377454ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.601501586s FAIL (2025-07-20 05:39:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.601530976s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.777253756s FAIL (2025-07-20 05:39:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.777284301s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 915.564551ms FAIL (2025-07-20 05:39:05 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 915.700301ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 10.951795304s FAIL (2025-07-20 05:38:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 10.951823182s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.119043084s FAIL (2025-07-20 05:37:53 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.119087119s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.639313636s FAIL (2025-07-20 05:37:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.639346912s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.876601609s FAIL (2025-07-20 05:37:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.876623384s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 871.250265ms FAIL (2025-07-20 05:37:01 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 871.285281ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 3.025738844s FAIL (2025-07-20 05:36:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.025779411s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 907.923163ms FAIL (2025-07-20 05:35:59 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 907.954225ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 932.954493ms FAIL (2025-07-20 05:35:35 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 932.986983ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.627238348s FAIL (2025-07-20 05:35:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.627288101s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 874.463054ms FAIL (2025-07-20 05:35:14 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 874.511125ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.770770083s FAIL (2025-07-20 05:34:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.770801409s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.106996538s FAIL (2025-07-20 05:34:17 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.107033596s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 877.09226ms FAIL (2025-07-20 05:33:39 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 877.116758ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.579177532s FAIL (2025-07-20 05:33:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.579218462s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.727325535s FAIL (2025-07-20 05:33:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.727352691s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 943.744803ms FAIL (2025-07-20 05:32:37 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 943.777388ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.616285053s FAIL (2025-07-20 05:32:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.616322657s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 987.749166ms FAIL (2025-07-20 05:31:28 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 987.779225ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.518804907s FAIL (2025-07-20 05:31:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.518836101s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.567750267s FAIL (2025-07-20 05:30:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.567782027s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.236995442s FAIL (2025-07-20 05:30:43 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.237024136s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 892.519689ms FAIL (2025-07-20 05:30:19 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 892.557347ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.538900539s FAIL (2025-07-20 05:29:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.538937499s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.848927463s FAIL (2025-07-20 05:29:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.84896454s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 896.44097ms FAIL (2025-07-20 05:29:19 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 896.473329ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 3.031559717s FAIL (2025-07-20 05:28:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.031589177s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 969.901425ms FAIL (2025-07-20 05:28:09 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 969.928769ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.002420176s FAIL (2025-07-20 05:27:51 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.002450362s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.76489483s FAIL (2025-07-20 05:27:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.7649697s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 911.717115ms FAIL (2025-07-20 05:26:44 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 911.743873ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.880045277s FAIL (2025-07-20 05:26:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.880082625s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.575527661s FAIL (2025-07-20 05:26:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.575585328s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 976.264172ms FAIL (2025-07-20 05:25:48 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 976.298393ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.237098733s FAIL (2025-07-20 05:25:33 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.237145415s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.510867935s FAIL (2025-07-20 05:24:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.510900317s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 979.934322ms FAIL (2025-07-20 05:24:19 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 979.971607ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 969.478439ms FAIL (2025-07-20 05:23:59 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 969.506776ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.562387688s FAIL (2025-07-20 05:23:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.562417269s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.096106991s FAIL (2025-07-20 05:23:23 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.096138204s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.605338944s FAIL (2025-07-20 05:23:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.605378707s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 938.827012ms FAIL (2025-07-20 05:22:48 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 938.858663ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.6561768s FAIL (2025-07-20 05:22:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.656205192s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.143664486s FAIL (2025-07-20 05:21:58 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.143695977s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 924.611502ms FAIL (2025-07-20 05:21:35 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 924.63717ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.773277568s FAIL (2025-07-20 05:21:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.773320976s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)