Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 976.264172ms FAIL (2025-07-20 05:25:48 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 976.298393ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.237098733s FAIL (2025-07-20 05:25:33 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.237145415s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.510867935s FAIL (2025-07-20 05:24:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.510900317s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 979.934322ms FAIL (2025-07-20 05:24:19 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 979.971607ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 969.478439ms FAIL (2025-07-20 05:23:59 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 969.506776ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.562387688s FAIL (2025-07-20 05:23:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.562417269s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.096106991s FAIL (2025-07-20 05:23:23 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.096138204s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.605338944s FAIL (2025-07-20 05:23:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.605378707s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 938.827012ms FAIL (2025-07-20 05:22:48 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 938.858663ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.6561768s FAIL (2025-07-20 05:22:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.656205192s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.143664486s FAIL (2025-07-20 05:21:58 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.143695977s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 924.611502ms FAIL (2025-07-20 05:21:35 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 924.63717ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.773277568s FAIL (2025-07-20 05:21:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.773320976s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 883.699591ms FAIL (2025-07-20 05:20:49 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 883.742678ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 879.566511ms FAIL (2025-07-20 05:20:24 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 879.587296ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 7.100993829s FAIL (2025-07-20 05:20:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.101024193s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 895.214148ms FAIL (2025-07-20 05:19:41 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 895.246468ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 11.230195243s FAIL (2025-07-20 05:19:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 11.230228577s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 978.809278ms FAIL (2025-07-20 05:19:15 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 978.845593ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 874.33604ms FAIL (2025-07-20 05:18:45 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 874.36899ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.539446271s FAIL (2025-07-20 05:18:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.539475697s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 905.480826ms FAIL (2025-07-20 05:17:59 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 905.519289ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.615291458s FAIL (2025-07-20 05:17:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.615318278s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 895.973388ms FAIL (2025-07-20 05:16:55 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 896.006241ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.502920695s FAIL (2025-07-20 05:16:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.502945924s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.108438651s FAIL (2025-07-20 05:16:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments... Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment... Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment. Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece... Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments... Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761 , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100 , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078 , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257 , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281 , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017 , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925 , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207 , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105 , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002 , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014 , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003 , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719 , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil> Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689 , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650 , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238 , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618 , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272 , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments... Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.108464523s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 913.362855ms FAIL (2025-07-20 05:16:05 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 913.397174ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 884.034744ms FAIL (2025-07-20 05:15:19 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 884.059861ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 931.195111ms FAIL (2025-07-20 05:15:00 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 931.231471ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.884542587s FAIL (2025-07-20 05:13:56 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.88457635s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.179844323s FAIL (2025-07-20 05:13:18 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.179945122s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.04547233s FAIL (2025-07-20 05:12:29 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.045504005s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 886.364067ms FAIL (2025-07-20 05:11:54 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 886.41617ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 914.983265ms FAIL (2025-07-20 05:10:49 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 915.011381ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.3245825s FAIL (2025-07-20 05:09:38 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.324610519s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 946.28274ms FAIL (2025-07-20 05:08:36 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 946.312307ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 953.701477ms FAIL (2025-07-20 05:07:35 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 953.730171ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 966.997134ms FAIL (2025-07-20 05:06:36 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 967.024164ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.451162869s FAIL (2025-07-20 05:05:33 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.451188266s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.096178267s FAIL (2025-07-20 05:04:36 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.096212312s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.026954241s FAIL (2025-07-20 05:03:32 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.027005354s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.01943267s FAIL (2025-07-20 05:03:02 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.019468169s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 912.751834ms FAIL (2025-07-20 05:02:44 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 912.788424ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 888.796704ms FAIL (2025-07-20 05:01:45 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 888.888407ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 915.520673ms FAIL (2025-07-20 05:00:51 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 915.554395ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.18335704s FAIL (2025-07-20 05:00:33 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.183499876s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 921.08831ms FAIL (2025-07-20 04:59:50 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 921.157199ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 906.174919ms FAIL (2025-07-20 04:58:51 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 906.276679ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 877.118757ms FAIL (2025-07-20 04:57:49 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 877.146249ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 866.875689ms FAIL (2025-07-20 04:57:09 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 866.906048ms core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)