Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X...X..................................................] duration: 2.335255176s FAIL (2025-10-07 10:51:07 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.335293454s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.555148355s FAIL (2025-10-07 10:50:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.555202638s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 932.795137ms FAIL (2025-10-07 10:50:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 932.845144ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X...X.................................................] duration: 2.078837942s FAIL (2025-10-07 10:50:34 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.078871727s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X...X................................................] duration: 1.966989733s FAIL (2025-10-07 10:50:16 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 1.96702679s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.043243859s FAIL (2025-10-07 10:50:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.043277848s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.365255908s FAIL (2025-10-07 10:49:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.365286398s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 933.045969ms FAIL (2025-10-07 10:49:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 933.072289ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.455217511s FAIL (2025-10-07 10:49:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.455251374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.516156001s FAIL (2025-10-07 10:49:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.516191365s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X...X...............................................] duration: 2.325618504s FAIL (2025-10-07 10:49:04 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.325652614s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.038253136s FAIL (2025-10-07 10:48:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.03828398s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X...X..............................................] duration: 1.984817119s FAIL (2025-10-07 10:48:36 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 1.984855764s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.314488626s FAIL (2025-10-07 10:48:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.314510764s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 997.66193ms FAIL (2025-10-07 10:48:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 997.691885ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.606831065s FAIL (2025-10-07 10:47:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.606864415s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.195986024s FAIL (2025-10-07 10:47:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.196032432s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration: 2.052795036s FAIL (2025-10-07 10:47:27 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.05282663s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.313063596s FAIL (2025-10-07 10:47:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.313099041s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X...X............................................] duration: 2.143640411s FAIL (2025-10-07 10:47:06 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.143668215s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.00968956s FAIL (2025-10-07 10:46:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.009722558s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X...X...........................................] duration: 2.059682981s FAIL (2025-10-07 10:46:33 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.059719438s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.548401471s FAIL (2025-10-07 10:46:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.548433227s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 938.639688ms FAIL (2025-10-07 10:45:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 938.67742ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.520556904s FAIL (2025-10-07 10:45:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.520586663s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration: 1.962063416s FAIL (2025-10-07 10:45:21 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 1.962117017s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration: 2.396385207s FAIL (2025-10-07 10:45:03 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.396437189s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.387606258s FAIL (2025-10-07 10:44:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.387722589s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 997.574203ms FAIL (2025-10-07 10:44:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 997.602321ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 933.20051ms FAIL (2025-10-07 10:44:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 933.234673ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X...X........................................] duration: 2.277481811s FAIL (2025-10-07 10:44:03 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.277518608s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 968.149875ms FAIL (2025-10-07 10:43:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 968.199738ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X...X.......................................] duration: 2.237849304s FAIL (2025-10-07 10:43:38 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.238553023s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.52574921s FAIL (2025-10-07 10:43:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.525779956s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.36413616s FAIL (2025-10-07 10:42:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.364167211s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X...X......................................] duration: 2.222310631s FAIL (2025-10-07 10:42:40 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.222340308s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 949.078213ms FAIL (2025-10-07 10:42:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 949.106197ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration: 2.428312856s FAIL (2025-10-07 10:42:22 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.428340556s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.170705592s FAIL (2025-10-07 10:42:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.170728509s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.506913259s FAIL (2025-10-07 10:42:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.506949977s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X...X....................................] duration: 2.387418389s FAIL (2025-10-07 10:42:01 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.387513747s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X...X...................................] duration: 2.354987728s FAIL (2025-10-07 10:41:12 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.355017945s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.609588604s FAIL (2025-10-07 10:41:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.609623352s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 930.393083ms FAIL (2025-10-07 10:41:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 930.484083ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.495528185s FAIL (2025-10-07 10:40:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.495626736s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.020059495s FAIL (2025-10-07 10:40:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.020092272s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.599937226s FAIL (2025-10-07 10:40:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.599967472s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration: 2.137599922s FAIL (2025-10-07 10:40:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.137632757s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.012154087s FAIL (2025-10-07 10:40:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.012186569s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.395891148s FAIL (2025-10-07 10:39:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments... Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment... Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment. Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece... Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments... Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil> Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces. Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments... Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.395943639s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)